In response to the calls for making key stakeholders' perspectives relevant in the test validation process, the study discussed in this report sought test-taker feedback as part of collecting validity evidence and supporting the ongoing field testing efforts of the new "TOEFL ITP"® Speaking section. Specifically, I aimed to investigate…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

Teaching English speaking has become a centre of attention among scholars and teaching English to speakers of other languages (TESOL) practitioners for a few decades. However, the issue of teaching English speaking in "Kampung Inggris"/English Village remains under-researched, notably viewed from the tutors' challenges and solutions in…

This study investigated a range of fluency, grammar, vocabulary, and content features of young language students' speaking performances, using a discourse-analytic approach. In total, 179 test takers' responses to the speaking section of the "TOEFL Junior"® Comprehensive test were selected for analysis. Mixed-design ANOVAs were used to…

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated…

This paper describes the development and evaluation of Interaction Competence Elicitor (ICE), a spoken dialog system (SDS) for the delivery of a paired oral discussion task in the context of language assessment. The purpose of ICE is to sustain a topic-specific conversation with a test taker in order to elicit discourse that can be later judged to…

Various examinations are administered at universities across the US as a means of assessing bilingual/multilingual international teaching assistants' (ITAs') proficiency in spoken English before they are permitted to teach. While such exams are taken by students in a range of academic disciplines, recent research suggests that communicative…

Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

This study critically examined the previously reported partial independence between second language (L2) accentedness (degree to which L2 speech differs from the target variety) and comprehensibility (ease of understanding). In prior work, comprehensibility was linked to multiple linguistic dimensions of L2 speech (phonology, fuency, lexis,…

This study employed a blended learning approach to investigate 98 medical university EFL students' perceptions and analyzed the learning trajectory of their LMOOCs in formal education. Meanwhile, Byram's (1997) intercultural communicative competence (ICC) model was adopted to explore if students' English proficiency and ICC abilities could enhance…

Admission in English-medium universities or institutions of higher education depends on the results obtained by candidates in large-scale proficiency tests including Test of English as a Foreign Language (TOEFL) internet-based test (iBT). The structure and administration procedure of the TOEFL iBT speaking test leaves no room for carrying out…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…

This study employed narrative inquiry to understand the oral English learning motivation of Chinese international students with low oral English proficiency through their academic acculturation stories. Expectancy-value theory served as the theoretical framework to inform the study design and the interpretation of results. Findings suggest all…

As a result of the fact that judgments of non-native speech are closely tied to social biases, oral proficiency ratings are susceptible to error because of rater background and social attitudes. In the present study we seek first to estimate the variance attributable to rater background and attitudinal variables on novice raters' assessments of L2…