The way in which validity has been conceptualized has changed throughout the years. The focus in validation studies shifted from evaluating distinct components of validity to developing a comprehensive argument for the use and interpretations of test scores. The argument-based approach to validity incorporates the distinct types of the…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

Test de Connaissance du Français (TCF), a French knowledge test for any non-native speakers of French, is an official language exam for the certificate of proficiency in French designed by France Éducation international (FIE) and accredited by le Ministère Français de l'Éducation Nationale, de la Jeunesse et des Sports (French Ministry of National…

This paper presents a critical evaluation of the English Test for International Communication (ETIC), a large-scale, computer-based, and criterion-referenced English language proficiency test developed by the China Language Assessment in 2016. The ETIC test battery comprises five categories: Basic, Intermediate, Advanced, Superior, and…

The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

Language proficiency testing has long played a role as both facilitator and barrier in global migration. This paper outlines how Canada and other traditional migrant destination countries use English-language proficiency testing for immigration, asylum and resettlement, and citizenship. It identifies commonalities between these three related areas…

In this paper we use historic score-reporting records and test-taker metadata to inform data-driven recommendations that support international students in their choice of undergraduate institutions for study in the United States. We investigate the use of Structural Topic Modeling (STM) as a context-aware, probabilistic recommendation method that…

Many candidates undertaking high-stakes English language proficiency tests for academic enrolment do not achieve the results they need for reasons including linguistic unreadiness, test unpreparedness, illness, an unfavourable configuration of tasks, or administrative and marking errors. Owing to the importance of meeting goals or out of a belief…

The ACTFL Assessment of Performance Toward Proficiency in Languages (AAPPL, https://www.actfl.n.d.org/assessments/k-12-assessments/aappl) assesses proficiency in 11 languages for students in grades 3 to 12 and is often used to award the Seal of Biliteracy. While arguments for the valid interpretation and uses of the AAPPL have previously been…

In this contribution, I argue for a radical reappraisal of accepted ideas about how English is taught and tested. I am not alone in questioning the validity of the current orthodoxy. Others have expressed views that correspond or are consistent with the points I make here. What I have sought to do is to synthesize them in the formulation of a…

This paper addresses the intersection of testing and policy, situating test-driven impact and validation within the context of policy-led educational reform in Korea. I will briefly review the existing validation models. Then, arguing for an expansion of the conventional conceptualization of consequential validity research, I use Fairclough's…

Taking a psycholinguistic perspective, this book investigates how second language (L2) learners' pragmatic abilities in English can be measured. It complements and extends earlier work on the testing of implicit and explicit grammar. The authors present a set of tests they developed using both well-established methods of measuring pragmatic…

Modern Foreign Languages (MFL) as a secondary school subject is affected by two policies, namely the English Baccalaureate (EBacc) and Progress 8, which contribute to the measurement of performance in exams at age 16 (GCSEs). In this paper, I discuss the concept of performance measurement in schools and the purpose it purportedly serves, before…

This paper probes into implicit language aptitude (LA), a set of cognitive abilities that showcase learners' unconscious, automatic second language (L2) attainment. Implicit LA is becoming an important part of aptitude research, and advances the understanding of L2 learning mechanism. This paper critiques the construct of implicit LA and proposes…

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have…