The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

With this study I investigate the consequential validity of a state English language proficiency (ELP) assessment, following Messick's (1989) expanded theory on validity. I examined intended and unintended consequences of the Texas English Language Proficiency Assessment System (TELPAS) through stakeholder perceptions. TELPAS is a federally…

The study aimed to elicit information from Vietnamese EFL university instructors about their knowledge and skills regarding the principles, theory, and practices of language assessment by means of revision and validation of the Language Assessment Literacy--Revised Vietnam (LAL-RV), which was previously developed by Kremmel and Harding (2020). A…

Pragmatic competence has been increasingly recognized as a component of academic language proficiency assessment (Youn, 2018). However, the practicality of administering L2 pragmatic competence assessments involving interlocutors remains problematic (e.g., high labor cost) (Ikeda, 2017). The pandemic makes it even more difficult to administer…

Recent research in the areas of second language testing and learner corpus research has provided increased insight into linguistic features of various score levels and into the meaning of a test score (Cushing, 2017; Knoch & Chapelle, 2018). However, language testing researchers have asserted the need to select linguistic features that are…

The purpose of this study was to analyze the use of reading strategies being implemented in an urban school district in the Southeast. This study was framed on the SIOP (Sheltered Instruction Observation Protocol) Model (Echevarria et al., 2017). SIOP is an instructional framework that has been used in K-12 schools since the 1980s. It is a…

The present dissertation investigated the impact of scales/scoring methods and prompt linguistic features on the measurement quality of L2 English elicited imitation (EI). Scales/scoring methods are an important feature for the validity and reliability of L2 EI test, but less is known (Yan et al., 2016). Prompt linguistic features are also known…

English has emerged as an international language. The hegemonic positioning of English is problematic for previously colonized places such as the Republic of the Marshall Islands. The remote coral atoll Pacific Island nation of the Republic of the Marshall Islands has a history of colonization. Critical Literacy supports reflective analysis of…

Achieving sufficient proficiency in academic writing is critical in university level setting. It is not surprising hence, that the admission to English speaking universities is usually conditioned not only by a particular total score from Standardized tests of English proficiency, e.g., TOEFL or IELTs but also a specific band score in writing. To…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

Some scientists believe that speaking a second language could confer lasting cognitive advantages in aging and stave off the onset of dementia (Bialystok et al., 2007; Craik et al., 2010; Abutalebi & Rietbergen, 2014; Grant et al., 2014; Woumans et al., 2015; Klein et al., 2016; Abutalebi & Green, 2016; Smirnov et al., 2019). However, this…

Syntactic (i.e., grammatical) complexity refers to the range and the degree of sophistication of the forms that appear in language production (Ortega, 2003). This concept has long been regarded as an important construct of language proficiency and has been actively investigated in the field of second language (L2) writing. Syntactic complexity is…

Pseudowords (words that are not real but resemble real words in a language) have been used increasingly as a technique to reduce contamination due to construct-irrelevant variance in assessments of verbal fluid reasoning (Gf). However, despite pseudowords being researched heavily in other psychology sub-disciplines, they have received little…

This study of the assets that international graduate students bring to the process of learning English academic writing in the US has two purposes. The primary purpose is to develop the Translingual Graduate Writers' Inventory of Strengths (TGWIS) and to test its reliability and validity as a tool to determine the particular strengths and…

Latinx dual language learners (DLLs) are an enormous and growing student body that faces educational adversities and inequities. One of the most salient findings to emerge from decades of educational research is that DLLs who close the gap with their monolingual peers and have the best long-term academic performance are those who develop strong…