ERIC Number: ED421536
Record Type: Non-Journal
Publication Date: 1998-Apr
Pages: 30
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
The Effects of Content Representativeness and Differential Weighting on Test Equating: A Monte Carlo Study.
Kromrey, Jeffrey D.; Parshall, Cynthia G.; Yi, Qing
The effects of anchor test characteristics in the accuracy and precision of test equating in the "common items, nonequivalent groups design" were studied. The study also considered the effects of nonparallel based and new forms on the equating solution, and it investigated the effects of differential weighting on the success of equating under these conditions of nonrepresentative anchor tests and nonparallel test forms. Data were generated for this simulation study using a multidimensional item response theory approach to data from the American College Testing Program assessment in mathematics. The three weighting models included the traditional unweighted approach and two differential weighting methods, one with item weights obtained using the proportion of items in the anchor test relative to the proportion in the total test and one based on the proportion of item response theory information provided in each content area in the anchor test relative to the proportion in the total test. For the conditions examined in this study, the traditional unit weighting method outperformed both alternative methods. Despite the limited performance of the alternative methods in this study, they merit further study. (Contains 8 tables, 4 figures, and 17 references.) (SLD)
Descriptors: Equated Scores, High Schools, Item Response Theory, Monte Carlo Methods, Test Content, Test Items
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: ACT Assessment
Grant or Contract Numbers: N/A
Author Affiliations: N/A