The extrapolation of test scores to a target domain - that is, association between test performances and relevant real-world outcomes - is critical to valid score interpretation and use. This study examined the relationship between Duolingo English Test (DET) speaking scores and university stakeholders' evaluation of DET speaking performances. A…

High stakes test-based accountability systems primarily rely on aggregates and derivatives of scores from tests that were originally developed to measure individual student proficiency in subject areas such as math, reading/language arts, and now English language proficiency. Current validity models do not explicitly address this use of aggregate…

Standardizing accessible test design and development to meet students' individual access needs is a complex task. The following study provides one approach to accessible test design and development using participatory design methods with school community members. Participatory research provides opportunities to empower collaborators by co-creating…

Designing an effective K-12 alternate English language proficiency assessment (ELP) for English learners with significant cognitive disabilities (ELSCDs) is a substantial undertaking, particularly given the absence of design models for such an assessment and limited empirical research to guide test design teams. These challenges emphasized the…

Clinicians, educators, and researchers alike continue to struggle without adequate and functional tools to measure language proficiency in bilingual populations. Language proficiency refers to the ability of an individual to use a language. However, the ways in which proficiency is classified are inconsistent and potentially invalid. Proficiency…

The research note focuses on the alignment aspect of English language proficiency (ELP) assessments, one of the required types of validity evidence for the federal peer review process of states' assessment systems. A basic tenant of current U.S. education policy is the alignment between what a test assesses and what content has been determined as…

This article presents a critical review of the Texas English Language Proficiency Assessment System (TELPAS), a large scale standardized English language proficiency (ELP) assessment developed by the Texas Education Agency (TEA) and administered since 2004. TELPAS is used as an annual summative assessment for all English Learners (ELs) in grades…

Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language…

The RP Group's Multiple Measures Assessment Project (MMAP) produced this technical report as part of a series on how California's community colleges can ensure more English learners (ELs) successfully complete "gateway" English coursework -- courses that satisfy the English writing requirements for completion of an associate's degree as…

In this report I share the results of a document-based, comparative case study aimed at increasing our understanding about the potential utility of state kindergarten entry assessments (KEAs) to provide evidence of English learner (EL) kindergartners' knowledge and skills and, in turn, inform kindergarten teachers' instruction. Using a sample of 9…

This test review aims to provide a critical evaluation of the English Language Proficiency Assessment for the 21st Century (ELPA 21), a large-scale, standards-based English language proficiency testcurrently used in eight participating member states. The ELPA 21 assessment system was developed by a consortium to help English language learner (ELL)…

Reverse engineering (RE) can play an important role in the re-designing tests in L2 English. It can also enrich the aim of teaching the same as raising children through academic achievement. In addition, it can play a key role in helping students understand how much their test is valid by using Standard reverse engineering (SRE). This paper is a…

Students learning to read in more than one language, or emerging biliterates, are becoming increasingly common in schools. Early screening and identification of reading difficulties may lead to better outcomes for emerging biliterates as well as monolingual English students. Oral reading fluency (ORF) is one tool shown to be both a reliable…

Though previous research addresses the negative impact of state-mandated high school exit exams on English language learners' (ELLs) educational experiences, less attention has been given to how college-oriented ELLs, especially those who attended school in their home countries before coming to the US, handle rigorous exams or gain access to…

The overarching purpose of our study was to compare performances of treatment and control condition students who completed a literacy-infused, inquiry-based science intervention through sixth grade as measured by a big idea assessment tool which we refer to as the Big Ideas in Science Assessment (BISA). First, we determine the concurrent validity…