ERIC Number: EJ1350784
Record Type: Journal
Publication Date: 2022-Oct
Pages: 28
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: EISSN-1477-0946
Available Date: N/A
Assessing Rasch Measurement Estimation Methods across R Packages with Yes/No Vocabulary Test Data
Language Testing, v39 n4 p513-540 Oct 2022
Instrument measurement conducted with Rasch analysis is a common process in language assessment research. A recent systematic review of 215 studies involving Rasch analysis in language testing and applied linguistics research reported that 23 different software packages had been utilized. However, none of the analyses were conducted with one of the numerous R-based Rasch analysis software packages, which generally employ one of the three estimation methods: conditional maximum likelihood estimation (CMLE), joint maximum likelihood estimation (JMLE), or marginal maximum likelihood estimation (MMLE). For this study, eRm, a CMLE-based R package, was utilized to conduct a dichotomous Rasch analysis of a Yes/No vocabulary test based on the academic word list. The resulting parameters and diagnostic statistics were compared with the equivalent results from four other R-based Rasch measurement software packages and Winsteps. Finally, all of the packages were utilized in the analysis of 1000 simulated datasets to investigate the extent to which results generated from the contrasting estimation methods converged or diverged. Overall, the differences between the results produced with the three estimation methods were negligible, and the discrepancies observed between datasets were attributable to the software choice as opposed to the estimation method.
Descriptors: Programming Languages, Vocabulary Development, Language Tests, Computer Software, Applied Linguistics, Maximum Likelihood Statistics, Academic Language, Word Lists, Test Format, Test Items, Item Analysis, Measurement Techniques, English (Second Language), English for Academic Purposes, Second Language Learning, Second Language Instruction, Cross Cultural Studies, Foreign Countries, College Freshmen, Comparative Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub-com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan; Saudi Arabia
Grant or Contract Numbers: N/A
Data File: URL: https://doi-org.bibliotheek.ehb.be/10.17605/OSF.IO/5HF9U
Author Affiliations: N/A