ERIC Number: EJ1344544
Record Type: Journal
Publication Date: 2022
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: EISSN-1543-4311
Available Date: N/A
Application of Bi-Factor MIRT and Higher-Order CDM Models to an In-House EFL Listening Test for Diagnostic Purposes
Min, Shangchao; Cai, Hongwen; He, Lianzhen
Language Assessment Quarterly, v19 n2 p189-213 2022
The present study examined the performance of the bi-factor multidimensional item response theory (MIRT) model and higher-order (HO) cognitive diagnostic models (CDM) in providing diagnostic information and general ability estimation simultaneously in a listening test. The data used were 1,611 examinees' item-level responses to an in-house EFL listening test in China and five content experts' item-attribute coding results of the test form. The bi-factor MIRT model was compared with five CDMs with and without a higher-order structure in terms of model fit, attribute classification and general ability estimation. The results showed that the bi-factor MIRT model provided the best model-data fit, followed by the HO-G-DINA model, the saturated G-DINA model, and other reduced CDMs. The HO-G-DINA model produced attribute classification results more similar to the G-DINA model, whereas the bi-factor MIRT model offered better results in discriminating examinees' general listening ability. The findings of this study highlighted the feasibility of using the bi-factor MIRT model as an attractive alternative for diagnostic assessment, especially in language assessment where attributes are assumed to be continuous.
Descriptors: Listening Comprehension Tests, English (Second Language), Second Language Learning, Foreign Countries, Language Tests, Test Items, Item Response Theory, Diagnostic Tests, Specialists, Comparative Analysis, Models, Goodness of Fit, Classification, College Faculty, Second Language Instruction, College Students, Language Proficiency
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A
Author Affiliations: N/A