The present study is a partial replication of the most widely cited study of lexical coverage and reading comprehension by Hu and Nation (2000). Ninety-four advanced L2 learners read a short story at one of 90%, 95%, 98%, and 100% lexical coverage and then completed a 14-item reading comprehension test. The results showed that although…

This study investigates the adoption and impact of generative artificial intelligence (GenAI) tools on English as a foreign language (EFL) learners, focusing on self-efficacy, motivation, and predicted exam performance. Using a mixed-methods approach, the research combines survey data (N = 595) and interviews (N = 8) from Chinese university…

This study made triangulated use of eye-tracking and retrospective verbal reports (RVRs) to compare the banked gap-filling processes of two same-scorers and those of a top scorer and a bottom scorer. The two same-scorers differed in their cognitive effort on global and local processing, fluency of choice making, and strategy use when completing…

While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

Research in validity suggests that stakeholders' interpretation and use of test results should be an aspect of validity. Claims about the meaningfulness of test score interpretations and consequences of test use should be backed by evidence that stakeholders understand the definition of the construct assessed and the score report information. The…

This article outlines the development of a 16-item instrument for measuring language learner's foreign language self-efficacy (SE) concerning their speaking and listening skills through repeated administrations to groups of Japanese tertiary students. Responses were analysed through the Rasch model, which allows researchers to investigate…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

As information and communication technologies develop in China, language tests are shifting from conventional paper-and-pencil testing to computerized testing. The aim of this study is to investigate Chinese test-takers' adaptability to computerized language exams, including their performance across testing modes and their perception of the…

The present study was undertaken to investigate the use of contextual situations in teaching English tenses to university students. To achieve this objective, the study examined (1) whether there was a statistically significant difference between students' scores on the pre-test and post-test on present tenses based on contextual situations, and…

Local item dependency (LID) occurs when test-takers' responses to one test item are affected by their responses to another. It can be problematic if it causes inflated reliability estimates or distorted person and item measures. The cued-recall reading comprehension test in Hu and Nation's (2000) well-known and influential coverage--comprehension…

Public speaking, especially in a foreign language, is associated with increased anxiety. Research has shown the potential of virtual reality (VR) for simulating real-life experiences, allowing for public speaking practice in an ecological and safe environment. This between-subjects study investigated the effect of VR on foreign language anxiety…

The assessment of English speaking in EFL environments can be inherently subjective and influenced by various factors beyond linguistic ability, including choice of assessment criteria, and even the rubric type. In classroom assessment, the type of rubric recommended for English speaking tasks is the analytical rubric. Driven by three aims, this…

This study explored the relationship between task complexity, textual emotionality, and linguistic complexity in second language (L2) writing. Fifty-eight L2 English learners performed simple and complex versions of an argumentative writing task manipulated along with resource-­directing variables. The essays were first analysed for textual…

This research explores the effectiveness of Conversation Analysis (CA) transcription symbols in teaching English stress and intonation, as well as students' attitudes toward their role in understanding prosody. A quasi-experimental study was conducted with 43 undergraduates enrolled in an English conversation class. Participants were divided into…