This study investigated the test fairness of the translation section of a large-scale English test in China by examining its Differential Test Functioning (DTF) and Differential Item Functioning (DIF) across gender and major. Regarding DTF, the entire translation section exhibits partial strong measurement invariance across female and male…

In this study, we examined the effect of previewing unfamiliar vocabulary on the real-time reading behavior of first language (L1) and second language (L2) readers. University students with English as their L1 or L2 read passages with embedded pseudowords. In a within-participant manipulation, definitions of the pseudowords were either previewed…

English language students often struggle to acquire and retain academic vocabulary due to limited exposure and insufficient opportunities for meaningful engagement with new words. Explicit, structured vocabulary instruction is essential to acquire word ownership, defined as understanding a word's meaning and using it in various contexts. This…

This study investigates the effectiveness of the PACE approach (Adair-Hauck & Donato, 2002) for grammar teaching in beginning (novice mid/high) second language (L2) Spanish classes. Even though research has reported instructional benefits for PACE in L2 French (Groenveld, 2011), Alutiiq (Branson, 2015), and ESL (Harris, 2017; Ngo, 2018), to…

The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance,…

The extent to which L2 television is viewed by foreign language learners will depend on the degree to which it is understood. The addition of captions has been shown to support comprehension (e.g., Birulés-Muntané & Soto-Faraco, 2016; Montero-Perez, Peters, & Desmet, 2014), especially when proficiency is low (e.g., Lavaur & Bairstow,…

The statement stated in a multiple-choice question can be developed regarding two types of sentences: Interruptive (periodic) and cumulative (or loose). This study deals with different kinds of stems in designing multiple-choice (MC) items. To fill the existing gap in the literature, two groups of teacher students passing general English courses…

The purpose of this study is two-fold: 1) to investigate the effects of Data-Driven Learning (DDL) framed within the Involvement Load Hypothesis (ILH) on Thai learners' use of academic collocations and 2) to examine how Thai learners utilized the involvement load (IL) components (need, search, and evaluation) to master academic collocations. It is…

Among the variety of selected response formats used in L2 reading assessment, multiple-choice (MC) is the most commonly adopted, primarily due to its efficiency and objectiveness. Given the impact of assessment results on teaching and learning, it is necessary to investigate the degree to which the MC format reliably measures learners' L2 reading…

Research on the relationship between vocabulary knowledge and reading has largely focused on literal comprehension of informational texts. The present study, however, investigates the vocabulary-reading relationship by specifically examining critical reading skills in an argumentative text.76 EFL university students majoring in Education and…

This study shed light on the effects of four modes of vocabulary instruction, i.e., extended audio glossing, lexical inferencing, lexical translation, and frequency manipulation of input on the learning of lexical collocations by Iranian intermediate EFL learners. In so doing, 80 L1 Persian EFL students were divided into four 20-participant…

The increasing popularity of the Common European Framework of Reference (CEFR) in non-native English-speaking countries has generated a demand for concrete examples in the creation of CEFR-based tests that assess the four main English skills. In response, this research endeavors to provide insight into the development and validation of a…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

Foreign language testing is a multi-dimensional phenomenon and obtaining objective and error-free scores on learners' language skills is often problematic. While assessing foreign language performance on high-stakes tests, using different testing approaches including Classical Test Theory (CTT), Generalizability Theory (GT) and/or Item Response…