The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

With this study I investigate the consequential validity of a state English language proficiency (ELP) assessment, following Messick's (1989) expanded theory on validity. I examined intended and unintended consequences of the Texas English Language Proficiency Assessment System (TELPAS) through stakeholder perceptions. TELPAS is a federally…

The present dissertation investigated the impact of scales/scoring methods and prompt linguistic features on the measurement quality of L2 English elicited imitation (EI). Scales/scoring methods are an important feature for the validity and reliability of L2 EI test, but less is known (Yan et al., 2016). Prompt linguistic features are also known…

Clinicians, educators, and researchers alike continue to struggle without adequate and functional tools to measure language proficiency in bilingual populations. Language proficiency refers to the ability of an individual to use a language. However, the ways in which proficiency is classified are inconsistent and potentially invalid. Proficiency…

Students learning to read in more than one language, or emerging biliterates, are becoming increasingly common in schools. Early screening and identification of reading difficulties may lead to better outcomes for emerging biliterates as well as monolingual English students. Oral reading fluency (ORF) is one tool shown to be both a reliable…

Latinx dual language learners (DLLs) are an enormous and growing student body that faces educational adversities and inequities. One of the most salient findings to emerge from decades of educational research is that DLLs who close the gap with their monolingual peers and have the best long-term academic performance are those who develop strong…

Elicited Imitation (EI) is an assessment approach that uses sentence imitation tasks to gauge the oral proficiency level of test takers. EI tests have been created for several of the world's languages, including English, Spanish, Japanese, French, and Mandarin. Little research has been conducted for using the EI approach with learners of Russian.…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

Few classroom measures of English language proficiency have been evaluated for reliability and validity. This research examined the concurrent and predictive validity of an oral language test, titled A Developmental English Language Proficiency Test (ADEPT), and the relationship to the California English Language Development Test (CELDT) in the…

This study examined the second language (L2) development of adult learners of Spanish at three levels of proficiency during and after a semester of instruction. A fundamental goal was to identify cognitive and psychosocial individual differences (IDs) that can explain between-learner variation over time in order to expand our understanding of the…

By centralizing the issue of test fairness in language proficiency assessments, this study responds to a call by researchers for developing greater social responsibility in the language testing agenda. As inquiries into language attitude and psychology indicate, there is an underlying uncertainty pertaining to the validity of test use and score…

The CEPA-English test is used for achievement, selection, and placement purposes. Since this test has heavily influences student's academic futures, it is imperative to ensure that the test functions as intended and provides meaningful results. Therefore, the purpose of this study was to examine the technical quality of the CEPA-English test in…

Performance assessments have become the norm for evaluating language learners' writing abilities in international examinations of English proficiency. Two aspects of these assessments are usually systematically varied: test takers respond to different prompts, and their responses are read by different raters. This raises the possibility of undue…

This dissertation reports development and validation studies of a Web-based standardized test of Japanese as a foreign language (JFL), designed to measure learners' off-line grammatical and pragmatic knowledge in multiple-choice format. Targeting Japanese majors in the U.S. universities and colleges, the test is designed to explore possible…

This dissertation study examined the reliability and validity claims of a modified version of the Spanish Modern Language Association Foreign Language Proficiency Test for Teachers and Advanced Students administered at George Mason University (GMU). The study used the 1999 computerized GMU version that was administered to 277 test-takers via…