NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED628548
Record Type: Non-Journal
Publication Date: 2023
Pages: 71
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
A Sequential Bayesian Changepoint Detection Procedure for Aberrant Behaviors in Computerized Testing
Jing Lu; Chun Wang; Jiwei Zhang; Xue Wang
Grantee Submission
Changepoints are abrupt variations in a sequence of data in statistical inference. In educational and psychological assessments, it is pivotal to properly differentiate examinees' aberrant behaviors from solution behavior to ensure test reliability and validity. In this paper, we propose a sequential Bayesian changepoint detection algorithm to monitor the locations of changepoints for response times in real time and, subsequently, further identify the types of aberrant behaviors in conjunction with response patterns. Two simulation studies were conducted to investigate the efficiency and accuracy of the proposed detection procedure in terms of identifying one or multiple change points at different locations. In addition to manipulating the number and locations of changepoints, two types of aberrant behaviors were also considered: rapid guessing behavior and cheating behavior. Simulation results indicate that ability estimates could be improved after removing responses from aberrant behaviors identified by our approach. Two empirical examples were analyzed to illustrate the application of proposed sequential Bayesian changepoint detection procedure. [This paper will be published in "British Journal of Mathematical and Statistical Psychology."]
Publication Type: Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Program for International Student Assessment
IES Funded: Yes
Grant or Contract Numbers: R305D200015
Author Affiliations: N/A