The Hanyu Shuiping Kaoshi (HSK) is a multi-level, multi-purpose Chinese proficiency test developed by the Center for Language Education and Cooperation (previously the Office of Chinese Language Council International and, henceforth, referred to by its colloquial name "Hanban"). It assesses reading, writing, and listening skills of…

This corpus-based study investigates lexical bundles of keywords found in online news articles, aiming to equip high school students in Thailand with the linguistic tools necessary for English admission exams. The primary objectives of this investigation are twofold: (1) to compile a list of 100 essential exam preparation keywords from the…

Vocabulary assessment is an important part of measuring language proficiency in both monolingual and bilingual children. The LITMUS Cross-Linguistic Lexical Tasks (CLT) provides a framework for assessing the vocabulary of monolingual and bilingual children using a standardized procedure and comparable stimuli across languages. All language…

In this mixed-methods study, we investigated the relationship between instructional approach, students' self-efficacy beliefs, and students' English language proficiency, as well as the perceptions of the instructor and students regarding problem-based learning (PBL) in a College English course in China. Using path analysis, we assessed the…

A C-Test is a gap-filling test for measuring language competence in the first and second language. C-Tests are usually analyzed with polytomous Rasch models by considering each passage as a super-item or testlet. This strategy helps overcome the local dependence inherent in C-Test gaps. However, there is little research on the best polytomous…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

This study investigates how aspects of collocational proficiency affect the ratings that expert examiners give to second language (L2) English learner essays. Lexical proficiency is a multi-faceted phenomenon and certain aspects of it are particularly impactful on human judgements, including lexical sophistication and accuracy. However, the…

The sheer scale of the IELTS [International English Language Testing System] testing infrastructure and its unique position in the world of international education dictated some of the particular challenges that the IELTS Partners (British Council, IDP Education and Cambridge Assessment English) faced after the closure of test centres during the…

None of the most well-established indices within curriculum-based measurement of writing (CBM-W) assess students' use of vocabulary within writing. Yet vocabulary knowledge is fundamental to writing, as well as the other three domains of English language proficiency (reading, speaking, listening), and it is particularly crucial for English…

This study aimed to explore the effectiveness of learning the Chinese Proficiency Test (HSK) 1 reading course through the Udemy platform and assess the learner's satisfaction with learning the Chinese course on the Udemy platform. The participants were 30 zero-foundation learners with minimal exposure to basic Chinese expressions and were randomly…

This study is a conceptual replication of Ellis' 'Measuring implicit and explicit knowledge of a second language: A psychometric study', published in "Studies in Second Language Acquisition" (2005), aiming to establish the importance of including belief statements (hypothesized to increase processing demands) in the design of Elicited…

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

The current study examined the extent to which first language (L1) utterance fluency measures can predict second language (L2) fluency and how L2 proficiency moderates the relationship between L1 and L2 fluency. A total of 104 Japanese-speaking learners of English completed different argumentative speech tasks in their L1 and L2. Their speaking…

Research on Portuguese language exams in the language assessment field remains scarce. To bridge this gap, this study examined washback from the large-scale, high-stakes Portuguese proficiency tests created by the Center of Evaluation of Portuguese as a Foreign Language ("Centro de Avaliação de Português Língua Estrangeira," or CAPLE as…