Publication Date
| In 2026 | 0 |
| Since 2025 | 0 |
| Since 2022 (last 5 years) | 1 |
| Since 2017 (last 10 years) | 2 |
| Since 2007 (last 20 years) | 2 |
Descriptor
| Bias | 2 |
| Evaluators | 2 |
| Performance Based Assessment | 2 |
| Writing Tests | 2 |
| Academic Achievement | 1 |
| Accuracy | 1 |
| Case Studies | 1 |
| Decision Making | 1 |
| Discussion | 1 |
| English | 1 |
| English for Academic Purposes | 1 |
| More ▼ | |
Source
| Language Testing | 2 |
Publication Type
| Journal Articles | 2 |
| Reports - Research | 2 |
Education Level
| High Schools | 1 |
| Secondary Education | 1 |
Audience
Location
| Colombia | 1 |
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Wind, Stefanie A. – Language Testing, 2023
Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…
Descriptors: Evaluators, Decision Making, Student Characteristics, Performance Based Assessment
Trace, Jonathan; Janssen, Gerriet; Meier, Valerie – Language Testing, 2017
Previous research in second language writing has shown that when scoring performance assessments even trained raters can exhibit significant differences in severity. When raters disagree, using discussion to try to reach a consensus is one popular form of score resolution, particularly in contexts with limited resources, as it does not require…
Descriptors: Performance Based Assessment, Second Language Learning, Scoring, Evaluators

Peer reviewed
Direct link
