NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: ED597256
Record Type: Non-Journal
Publication Date: 2016-Apr-12
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-
EISSN: N/A
Available Date: N/A
Incorporating Mixed Item Formats in Computerized Adaptive Testing: A Comparison of Shadow Test and Bin-Structured Approach
Luo, Xin; Reckase, Mark D.; He, Wei
AERA Online Paper Repository, Paper presented at the Annual Meeting of the American Educational Research Association (Washington, DC, Apr 8-12, 2016)
While dichotomous item dominates the application of computerized adaptive testing (CAT), polytomous item and set-based item hold promises for being incorporated in CAT. However, how to assemble a CAT containing mixed item formats is challenging. This study investigated: (1) how the mixed CAT works compared with the dichotomous-item-based CAT; (2) how to develop a procedure assembling a CAT with mixed item formats. Two test assembly designs, shadow test and bin-structured approach, were compared under a variety of test conditions. The item pool shape, IRT model used during CAT (modified three-parameter model and two-parameter model), and test constrains for exposure rate, cognitive skills and content balance were manipulated to simulate various real test situations. The effect of test assembly was evaluated in terms of ability measurement accuracy, content balance, test security, and item usage. The results showed that (1) compared with dichotomous-item-based CAT, the mixed-item-based CAT was more efficient but had higher exposure rate; (2) the effects of bin-structured method and shadow test were comparable in test accuracy and content balance, while bin-structure method can improve the item usage and lead to more even distribution of exposure rate.
AERA Online Paper Repository. Available from: American Educational Research Association. 1430 K Street NW Suite 1200, Washington, DC 20005. Tel: 202-238-3200; Fax: 202-238-3250; e-mail: subscriptions@aera.net; Web site: http://www.aera.net
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A