Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…

This study investigates the validity of assessing L2 pragmatics in interaction using mixed methods, focusing on the evaluation inference. Open role-plays that are meaningful and relevant to the stakeholders in an English for Academic Purposes context were developed for classroom assessment. For meaningful score interpretations and accurate…

Partial dictation is a measure of EFL listening proficiency that can be easily constructed, administered, and scored by EFL teachers. However, it is controversial whether this form of test measures lower-order abilities exclusively or involves both lower- and higher-order abilities. In order to answer this question, a study was designed to examine…

Explores theoretical and practical issues surrounding authenticity in course-based assessment, drawing on data from a university-level Japanese language course in Australia. Examines a teaching and assessment activity based around interviewing native speakers outside the classroom, which was designed to optimize authenticity. (Author/VWL)

Investigated the test-taking processes of English-as-a-Foreign-Language (EFL) testees taking a multiple choice listening-comprehension test, evaluating the effectiveness of immediate retrospection for accessing such processes. Linguistic and non-linguistic knowledge was activated in a parallel manner for all subjects with input of various…