ERIC Number: EJ1272054
Record Type: Journal
Publication Date: 2020
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1062-7197
EISSN: N/A
Available Date: N/A
Use of Response Process Data to Inform Group Comparisons and Fairness Research
Ercikan, Kadriye; Guo, Hongwen; He, Qiwei
Educational Assessment, v25 n3 p179-197 2020
Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage in. This paper discusses and demonstrates the use of response process data in enhancing group comparison and fairness research methodologies. We propose two statistical approaches for identifying differential response processes which extend the differential item functioning (DIF) detection methods and demonstrate the complementary use of process data in comparing groups in two case studies. Our findings demonstrate the use of response process data in gaining insights about students' test-taking behaviors from different populations that go beyond what may be identified using response data only.
Descriptors: Data Use, Responses, Comparative Analysis, Test Bias, Groups, Evaluation, Reaction Time, Mathematics Tests, English Language Learners, Foreign Countries, Achievement Tests, Secondary School Students, International Assessment, Science Tests
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: North America; Canada; China; South Korea; United States
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A
Author Affiliations: N/A