The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

The present dissertation investigated the impact of scales/scoring methods and prompt linguistic features on the measurement quality of L2 English elicited imitation (EI). Scales/scoring methods are an important feature for the validity and reliability of L2 EI test, but less is known (Yan et al., 2016). Prompt linguistic features are also known…

Clinicians, educators, and researchers alike continue to struggle without adequate and functional tools to measure language proficiency in bilingual populations. Language proficiency refers to the ability of an individual to use a language. However, the ways in which proficiency is classified are inconsistent and potentially invalid. Proficiency…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

Knowledge of local norms and conventions of interaction and ability to use them appropriately as well as the ability to negotiate meaning with interlocutors are important for ESL graduate students and prospective teaching assistants in an English-speaking university context. The interactive communication (IC) assessment using a paired student…

Few classroom measures of English language proficiency have been evaluated for reliability and validity. This research examined the concurrent and predictive validity of an oral language test, titled A Developmental English Language Proficiency Test (ADEPT), and the relationship to the California English Language Development Test (CELDT) in the…

Social-emotional development, psychosocial functioning, and relational experiences have been shown to impact academic achievement and psychological well-being. Social skills have been identified as being particularly critical in promoting mental health and life-long success. Children with well-developed social skills (e.g., sharing, being…

Performance assessments have become the norm for evaluating language learners' writing abilities in international examinations of English proficiency. Two aspects of these assessments are usually systematically varied: test takers respond to different prompts, and their responses are read by different raters. This raises the possibility of undue…

The purpose of this study was to explore the major acculturation challenges faced by Saudi female students who study in the U.S. and to develop a scale to measure potential acculturation challenges. The construction of the scale was based on a table of specification that included nine domains of possible acculturation challenges: (a)…

This study examined the second language (L2) development of adult learners of Spanish at three levels of proficiency during and after a semester of instruction. A fundamental goal was to identify cognitive and psychosocial individual differences (IDs) that can explain between-learner variation over time in order to expand our understanding of the…

The CEPA-English test is used for achievement, selection, and placement purposes. Since this test has heavily influences student's academic futures, it is imperative to ensure that the test functions as intended and provides meaningful results. Therefore, the purpose of this study was to examine the technical quality of the CEPA-English test in…

This dissertation reports development and validation studies of a Web-based standardized test of Japanese as a foreign language (JFL), designed to measure learners' off-line grammatical and pragmatic knowledge in multiple-choice format. Targeting Japanese majors in the U.S. universities and colleges, the test is designed to explore possible…

This dissertation study examined the reliability and validity claims of a modified version of the Spanish Modern Language Association Foreign Language Proficiency Test for Teachers and Advanced Students administered at George Mason University (GMU). The study used the 1999 computerized GMU version that was administered to 277 test-takers via…