ERIC Number: EJ1208655
Record Type: Journal
Publication Date: 2019
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Available Date: N/A
An Item-Level Expected Classification Accuracy and Its Applications in Cognitive Diagnostic Assessment
Wang, Wenyi; Song, Lihong; Chen, Ping; Ding, Shuliang
Journal of Educational Measurement, v56 n1 p51-75 Spr 2019
Most of the existing classification accuracy indices of attribute patterns lose effectiveness when the response data is absent in diagnostic testing. To handle this issue, this article proposes new indices to predict the correct classification rate of a diagnostic test before administering the test under the deterministic noise input "and" gate (DINA) model. The new indices include an item-level expected classification accuracy (ECA) for attributes and a test-level ECA for attributes and attribute patterns, and both of them are calculated based solely on the known item parameters and Q-matrix. Theoretical analysis showed that the item-level ECA could be regarded as a measure of correct classification rates of attributes contributed by an item. This article also illustrates how to apply the item-level ECA for attributes to estimate the correct classification rate of attributes patterns at the test level. Simulation results showed that two test-level ECA indices, ECA_I_W (an index based on the independence assumption and the weighted sum of the item-level ECAs) and ECA_C_M (an index based on Gaussian Copula function that incorporates the dependence structure of the events of attribute classification and the simple average of the item-level ECAs), could make an accurate prediction for correct classification rates of attribute patterns.
Descriptors: Cognitive Tests, Classification, Accuracy, Diagnostic Tests, Testing, Models, Item Analysis, Test Items, Prediction, Item Response Theory
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com.bibliotheek.ehb.be/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A