ERIC Number: EJ739117
Record Type: Journal
Publication Date: 2004-Jun
Pages: 26
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Available Date: N/A
Effects of Practical Constraints on Item Selection Rules at the Early Stages of Computerized Adaptive Testing
Chen, Shu-Ying; Ankenman, Robert D.
Journal of Educational Measurement, v41 n2 p149-174 Jun 2004
The purpose of this study was to compare the effects of four item selection rules--(1) Fisher information (F), (2) Fisher information with a posterior distribution (FP), (3) Kullback-Leibler information with a posterior distribution (KP), and (4) completely randomized item selection (RN)--with respect to the precision of trait estimation and the extent of item usage at the early stages of computerized adaptive testing. The comparison of the four item selection rules was carried out under three conditions: (1) using only the item information function as the item selection criterion; (2) using both the item information function and content balancing; and (3) using the item information function, content balancing, and item exposure control. When test length was less than 10 items, FP and KP tended to outperform F at extreme trait levels in Condition 1. However, in more realistic settings, it could not be concluded that FP and KP outperformed F, especially when item exposure control was imposed. When test length was greater than 10 items, the three nonrandom item selection procedures performed similarly no matter what the condition was, while F had slightly higher item usage.
Descriptors: Test Length, Adaptive Testing, Computer Assisted Testing, Test Selection, Evaluation Criteria, Test Items, Test Content, Item Analysis, Comparative Testing, Effect Size
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: customerservices@blackwellpublishing.com; Web site: http://www.blackwellpublishing.com/jnl_default.asp.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A