ERIC Number: EJ1358553
Record Type: Journal
Publication Date: 2022
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0973
EISSN: EISSN-1940-0683
Available Date: N/A
Examining Cognitive Diagnostic Modeling in Classroom Assessment Conditions
Paulsen, Justin; Valdivia, Dubravka Svetina
Journal of Experimental Education, v90 n4 p916-933 2022
Cognitive diagnostic models (CDMs) are a family of psychometric models designed to provide categorical classifications for multiple latent attributes. CDMs provide more granular evidence than other psychometric models and have potential for guiding teaching and learning decisions in the classroom. However, CDMs have primarily been conducted using large samples. This study examines estimating CDMs in small sample conditions to aid formative learning. Three CDMs were compared across simulated classroom assessment conditions: deterministic input, noisy "and" gate (DINA) model, non-parametric cognitive diagnosis (NPCD), and supervised artificial neural network (SANN). We found all models estimated examinee classifications at the smallest sample size. Accuracy of individual attribute mastery classifications was acceptably high for the models under certain conditions. Effective item discrimination was the most important factor to accurately classify. The DINA and NPCD models were more resilient to measurement error than the SANN. Recommendations for application of CDMs in the classroom are provided.
Descriptors: Psychometrics, Classification, Teaching Methods, Learning Processes, Decision Making, Classroom Environment, Comparative Analysis, Artificial Intelligence, Sample Size, Accuracy, Item Analysis, Diagnostic Tests, Mastery Learning, Error of Measurement, Formative Evaluation, Monte Carlo Methods
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A