ERIC Number: EJ1468153
Record Type: Journal
Publication Date: 2025-Apr
Pages: 35
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: EISSN-1935-1054
Available Date: 0000-00-00
Detecting Compromised Items with Response Times Using a Bayesian Change-Point Approach
Yang Du1; Susu Zhang2
Journal of Educational and Behavioral Statistics, v50 n2 p296-330 2025
Item compromise has long posed challenges in educational measurement, jeopardizing both test validity and test security of continuous tests. Detecting compromised items is therefore crucial to address this concern. The present literature on compromised item detection reveals two notable gaps: First, the majority of existing methods are based upon a non-Bayesian framework; second, many of these approaches exclusively rely on examinees' responses for detection, neglecting valuable data such as response times. In this study, we propose a Bayesian change-point method that integrates both responses and response times to detect compromised items in continuous tests. This two-phase approach is designed for iterative use. The accuracy and efficiency of the proposed method are assessed in three simulations and an operational data example. The results demonstrate the method's effectiveness in accurately and efficiently detecting compromised items. Additionally, the incorporation of response times significantly enhances both detection accuracy and efficiency.
Descriptors: Item Response Theory, Item Analysis, Bayesian Statistics, Educational Assessment, Accuracy, Efficiency, Evaluation Methods, Computer Assisted Testing, Information Security, Classification, Evaluation Criteria, Test Format
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub-com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Nvidia Corp.; 2University of Illinois Urbana-Champaign