This study investigated a range of fluency, grammar, vocabulary, and content features of young language students' speaking performances, using a discourse-analytic approach. In total, 179 test takers' responses to the speaking section of the "TOEFL Junior"® Comprehensive test were selected for analysis. Mixed-design ANOVAs were used to…

This study examined the impact of the manipulated task complexity (Robinson 2001a, 2001b, 2007, 2011; Robinson & Gilabert, 2007) on second language (L2) speech comprehensibility. I examined whether manipulated task complexity (a) impacts L2 speech comprehensibility, (b) aligns with L2 speakers' perception of task difficulty (cognitive…

This study critically examined the previously reported partial independence between second language (L2) accentedness (degree to which L2 speech differs from the target variety) and comprehensibility (ease of understanding). In prior work, comprehensibility was linked to multiple linguistic dimensions of L2 speech (phonology, fuency, lexis,…

The present study investigates integrated writing assessment performances with regard to the linguistic features of complexity, accuracy, and fluency (CAF). Given the increasing presence of integrated tasks in large-scale and classroom assessments, validity evidence is needed for the claim that their scores reflect targeted language abilities.…

Examining spoken features across proficiency levels allows researchers to explore the nature of speaking proficiency as it develops. This line of research has thus far primarily focused on adult second language (L2) learners. Using cross-sectional data based on a large-scale language assessment intended for young L2 learners, in this study, we…

The current study investigated task effects on listener perception of second language (L2) comprehensibility (ease of understanding). Sixty university-level adult speakers of English from 4 first language (L1) backgrounds (Chinese, Romance, Hindi, Farsi), with 15 speakers per group, were recorded performing 2 tasks (IELTS long-turn speaking task…

The purpose of this study was to determine the extent to which performance on the TOEFL iBT speaking section is associated with other indicators of Japanese university students' abilities to communicate orally in an academic English environment and to determine which components of oral ability for these tasks are best assessed by TOEFL iBT. To…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

Comprehensibility, a major concept in second language (L2) pronunciation research that denotes listeners' perceptions of how easily they understand L2 speech, is central to interlocutors' communicative success in real-world contexts. Although comprehensibility has been modeled in several L2 oral proficiency scales--for example, the Test of English…

This report documents two coordinated exploratory studies into the nature of oral English-for-academic-purposes (EAP) proficiency. Study I used verbal-report methodology to examine field experts? rating orientations, and Study II investigated the quality of test-taker discourse on two different Test of English as a Foreign Language? (TOEFL®) task…