This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

The purpose of this study was to develop and test the internal and external reliability of a novel research instrument which measures language support for international faculty members and its effects on integration. While previous research has focused on the contributions of international faculty and efforts to attract them, growing concerns…

This study aimed to develop and validate an analytical rating scale specifically designed to assess the lexical proficiency of Chinese college students in Academic English speaking tasks. A multi-layer construct of lexical proficiency was first developed and operationalized into an eight-dimension rating scale, including word diversity, word…

We describe the development and initial validation of the "ASL Fingerspelling and Number Comprehension Test" (ASL FaN-CT), a test of recognition proficiency for fingerspelled words in American Sign Language (ASL). Despite the relative frequency of fingerspelling in ASL discourse, learners commonly struggle to produce and perceive…

This study presents a modified version of the Korean Elicited Imitation (EI) test, designed to resemble natural spoken language, and validates its reliability as a measure of proficiency. The study assesses the correlation between average test scores and Test of Proficiency in Korean (TOPIK) levels, examining score distributions among beginner,…

The National Matriculation English Test (NMET), also known as the Gaokao English Examination, is a high-stakes, large-scale selection test for tertiary education in China, with numerous provinces and regions adopting the standardized national test papers. The validity of the NMET has garnered extensive attention. To verify the NMET's validity, it…

C-Test is a gap-filling test designed to measure first and second language proficiency. Over the past four decades, researchers have shown the fit of C-Test data to parametric item response theory (IRT) models, but no study so far has shown the fit of C-Tests to nonparametric IRT models. The purpose of this study is to contribute to the ongoing…

The sociolinguistic context of language use contributes to individuals' linguistic knowledge. However, how it does so has yet to be fully conceptualised or quantitatively investigated within the language sciences. To meet this goal, a psychometrically sound evidence-based measure that captures important aspects of contextually influenced…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

Applicants must often demonstrate adequate English proficiency when applying to postsecondary institutions by taking an English language proficiency test, such as the TOEFL iBT, IELTS Academic, or Duolingo English Test (DET). Concordance tables aim to provide equivalent scores across multiple assessments, helping admissions officers to make fair…

This study aimed to adapt the Plurilingual and Pluricultural Competence scale (PPC) to the Russian-speaking population and to assess its psychometric properties. Five hundred and sixty-four undergraduate students from Western, Central, and Caucasian regions of Russia and Kazakhstan participated in the study. Internal consistency, factorial,…

Drawing on a growing body of research on the interface between corpus linguistics and second/foreign language testing and assessment, we adopted "Peykare," a large-scale, annotated, Persian written language resource to evaluate the content (i.e., coverage and typicality) and construct validity of a Persian language proficiency test…

Purpose: Functional language proficiency is presented as a conceptual framework that builds upon cultural--linguistic assets in bilingually developing children and bridges the theory of natural translation, translanguaging, and language brokering practices. A novel task was developed based on this framework for quantifying Spanish-English…

The purpose of this study is to explore the learning measurement model of English comprehensive ability based on the background of educational informatization. With the rapid development of educational information technology, English education is facing unprecedented opportunities and challenges. Under the background of information technology,…

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…