Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

While the goal of language teaching has been the development of practical communication, most language tests have stressed mastery of discrete linguistic skills. Oral language performance-based testing requires test-takers to use and perform in the language in actual communicative situations. The variations in communication created by the…