ERIC Number: EJ1469715
Record Type: Journal
Publication Date: 2025-Apr
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: EISSN-1477-0946
Available Date: 0000-00-00
A New Scoring Method for Item Response Theory Analysis of C-Tests
Language Testing, v42 n2 p167-192 2025
This study aimed to propose a new method for scoring C-Tests as measures of general language proficiency. In this approach, the unit of analysis is sentences rather than gaps or passages. That is, the gaps correctly reformulated in each sentence were aggregated as sentence score, and then each sentence was entered into the analysis as a polytomous item. Rasch partial credit model was applied to analyze the test. To investigate the effectiveness of the new method, the results of this new strategy were compared with those derived from passage and gap levels as well as combining locally dependent items using the dichotomous Rasch model, the rating scale model, and the partial credit model. The obtained scores from the administration of a C-Test comprising four English passages, each containing 25 gaps, to 160 participants were subjected to dichotomous and polytomous Rasch model analyses. The models were compared regarding individual item fit, person/item separation and reliability, global fit (e.g., deviance), unidimensionality, local item dependence, and person parameters. Results showed the effectiveness of the new scoring method. The suggested strategy increases the number of items compared to the super-item approach, provides information at the sentence level, and reduces the impact of local independence.
Descriptors: Item Response Theory, Language Tests, Test Items, Test Construction, Test Reliability, Scoring, Language Proficiency, Sentences, Scores, English (Second Language), Comparative Analysis, Item Analysis, Rating Scales, High Stakes Tests, Undergraduate Students, Foreign Countries
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub-com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Iran
Grant or Contract Numbers: N/A
Author Affiliations: 1TU Dortmund University, Germany; 2Islamic Azad University, Iran; 3Tabaran Institute of Higher Education, Iran; 4Fujian Normal University, China