ERIC Number: EJ1025453
Record Type: Journal
Publication Date: 2014
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1530-5058
EISSN: N/A
Available Date: N/A
Toward Increasing Fairness in Score Scale Calibrations Employed in International Large-Scale Assessments
Oliveri, Maria Elena; von Davier, Matthias
International Journal of Testing, v14 n1 p1-21 2014
In this article, we investigate the creation of comparable score scales across countries in international assessments. We examine potential improvements to current score scale calibration procedures used in international large-scale assessments. Our approach seeks to improve fairness in scoring international large-scale assessments, which often ignore item misfit in score scale calibrations. We also seek to obtain improved model-data fit estimates when calibrating international score scales. To this end, we examine the use of two alternative score scale calibration procedures: (a) a language-based score scale and (b) a more parsimonious international scale wherein a large proportion of international parameters are used with a subset of country-based parameters for items that misfit in the international scale. In our analyses, we used data from all 40 countries participating in the Progress in International Reading Literacy Study. Our findings revealed that current score scale calibration procedures yield large numbers of misfitting items (higher than 25% for some countries). Our proposed approach diminished the effects of proportion of item misfit on score scale calibrations and also yielded enhanced model-data fit estimates. These results lead to enhancing confidence in measurements obtained from international large-scale assessments.
Descriptors: Test Bias, Scores, International Programs, Educational Assessment, Accuracy, Test Items, Goodness of Fit, Reading Tests, Computation, Comparative Analysis, Correlation, Item Response Theory, Language, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Progress in International Reading Literacy Study
Grant or Contract Numbers: N/A
Author Affiliations: N/A