ERIC Number: ED643407
Record Type: Non-Journal
Publication Date: 2022
Pages: 128
Abstractor: As Provided
ISBN: 979-8-4387-9383-0
ISSN: N/A
EISSN: N/A
Available Date: N/A
Classification Consistency and Results Reporting of a Digital-First Computer-Adaptive Language Proficiency Test
Ramsey Lee Cardwell
ProQuest LLC, Ph.D. Dissertation, The University of North Carolina at Greensboro
The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such assessments. The first paper presents a simulation study investigating the use of CTT-based classification consistency methods in a computer-adaptive testing context. The second paper further investigates CTT-based classification consistency estimates by applying the methods from the first paper, as well as a bootstrapping-inspired approach, to operational test data from the DET. The third paper investigates the reporting of test-related information and test-taker results to results users through a focus group with North American postsecondary admissions professionals. Collectively, the studies address challenges in constructing validity arguments for digital-first high-stakes assessments. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml.]
Descriptors: Classification, Reliability, Language Proficiency, Computer Assisted Testing, Electronic Learning, Adaptive Testing, Educational Innovation, Psychometrics, Test Validity, Test Use, Language Tests, English (Second Language)
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A