The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

The Applied Language Centre at University College Dublin offers foreign language modules to students in ten languages at CEFR [Common European Framework of Reference for Languages] levels ranging from A1 to B2. Efforts have been underway in the Centre to standardise the assessment components across languages to ensure parity between module credits…

Studied the marking characteristics of experienced markers of GCSE role-play to ascertain the extent of variation between the marks they award and to determine whether more intermarker consistency could be obtained with a small increase in time for thought before a particular mark is awarded. Results underlie the importance of reducing the…

Describes a pilot on-line system of rater training developed at Hong Kong Polytechnic University to support the English Language Centre's English for academic purposes and English in the workplace subjects. Presents findings from a project that investigated raters' attitudes towards assessment and rater training, and evaluated the pilot on-line…

Investigated the relationship between Chinese character recognition and production by second-language learners. Subjects were 47 first-year Chinese language students in the United States. (15 references) (Author/CK)

Describes current procedures used for testing bilingual teachers in the United States and focuses on one means of assessment used in Arizona. Examinee questionnaire responses, teacher questionnaire responses and test section analysis all contributed evidence for validity. (33 references) (Author/CK)

Examined the validity of the pragmatic approach to test difficulty put forward by Child (1987). This study investigated whether the Child discourse-type hierarchy predicts text difficulty for second-language readers. Results suggested that this hierarchy may provide a sound basis for developing foreign-language tests when it is applied by trained…

The Australian Second Language Proficiency Ratings (ASLPR) is a scale that describes how second language proficiency develops on a scale from zero to native-like proficiency, providing performance descriptions in terms of practical tasks. Initially developed for English second language teaching, it has been adapted for English dialects in…