ERIC Number: EJ859991
Record Type: Journal
Publication Date: 2009
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0146-6216
EISSN: N/A
Available Date: N/A
Simultaneous Estimation of Overall and Domain Abilities: A Higher-Order IRT Model Approach
de la Torre, Jimmy; Song, Hao
Applied Psychological Measurement, v33 n8 p620-639 2009
Assessments consisting of different domains (e.g., content areas, objectives) are typically multidimensional in nature but are commonly assumed to be unidimensional for estimation purposes. The different domains of these assessments are further treated as multi-unidimensional tests for the purpose of obtaining diagnostic information. However, when the domains are disparate, assuming a single underlying ability across the domains is not tenable. Moreover, estimating domain proficiencies based on short tests can result in unreliable scores. This article presents a higher-order item response theory framework where an overall and multiple domain abilities are specified in the same model. Using a Markov chain Monte Carlo method in a hierarchical Bayesian framework, the overall and domain-specific abilities, and their correlations, are estimated simultaneously. The feasibility and effectiveness of the proposed model are investigated under varied conditions in a simulation study and illustrated using actual assessment data. Implications of the model for future test analysis and ability estimation are also discussed. (Contains 10 tables and 1 figure.)
Descriptors: Ability, Tests, Item Response Theory, Data Analysis, Markov Processes, Monte Carlo Methods, Bayesian Statistics, Computation, Test Length, Models, Correlation, Simulation
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A