ERIC Number: EJ1467361
Record Type: Journal
Publication Date: 2025
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1755-6031
EISSN: N/A
Available Date: 0000-00-00
Is One Comparative Judgement Exercise for One Exam Paper Sufficient to Set Qualification-Level Grade Boundaries?
Tom Benton
Research Matters, n39 p26-38 2025
This research draws on evidence from three qualifications taken in autumn 2020, when comparative judgement (CJ) was used as a key source of data in setting grade boundaries. In these cases, a separate CJ exercise was completed for each individual paper in the qualification so that standards could be maintained from a previous series. In this article, we explore what would have happened had we relied on a single CJ exercise on one paper to maintain standards in the whole qualification. We first examine whether evidence from different papers provides a consistent picture of changes in cohort ability between series. We then explore the impact of relying on evidence from one paper only on the precision with which we can identify appropriate qualification-level grade boundaries using CJ.
Descriptors: Comparative Analysis, Evaluative Thinking, Grades (Scholastic), Cohort Analysis, Grouping (Instructional Purposes), Research Papers (Students), Tests, Secondary Education, Foreign Countries, Scores, Instructional Program Divisions, English Literature, Psychology, Language Arts
Cambridge University Press & Assessment. Shaftesbury Road Cambridge CB2 8EA. Tel: 44-1223-553311; e-mail: directcs@cambridge.org; Web site: https://www.cambridgeassessment.org.uk/our-research/all-published-resources/research-matters/
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)
Grant or Contract Numbers: N/A
Author Affiliations: N/A