The rating of proficiency tests that use the Inter-agency Roundtable (ILR) and American Council on the Teaching of Foreign Languages (ACTFL) guidelines claims that each major level is based on hierarchal linguistic functions that require mastery of multidimensional traits in such a way that each level subsumes the levels beneath it. These…

Speech fluency has been extensively researched as a core construct for second language (L2) speaking assessment. Despite the broad consensus on its multifaceted nature, few researchers have empirically explored the dimensionality of this construct. Operationalizations of fluency vary across research and practice, using both holistic and…

This study investigated the effects of two types of classroom instructions on EFL learners' oral proficiency by implementing teachers' judgment. Two intact classes of EFL university students studied a compulsory subject of their department under two different types of classroom instruction. The first group of students was trained with explicit…

Because speaking appropriately and fluently is the ultimate goal in a foreign language learning process, the authenticity of dialogues in the ELT coursebooks becomes even more significant. However, it is rather doubtful whether the dialogues have the function of preparing students for the English language they are likely to encounter in daily life…

This study examined the relationship between oral fluency and use of multiword sequences (MWSs) across four proficiency levels (Low B1 to C1 of the Common European Framework of Reference). Data came from 56 learners taking the speaking test of the Test of English for Educational Purposes, and our analysis obtained different measures of fluency…

This study was designed to determine how well existing analytic rating scales functioned in the assessment of low- to mid-proficiency Japanese university students' interactive English speaking ability when engaged in small group discussions. Many-facet Rasch measurement (MFRM) was employed to evaluate the quality of adapted rating scales for…

Examining spoken features across proficiency levels allows researchers to explore the nature of speaking proficiency as it develops. This line of research has thus far primarily focused on adult second language (L2) learners. Using cross-sectional data based on a large-scale language assessment intended for young L2 learners, in this study, we…

This study develops a model of analytic rating scales to assess L2 Chinese oral performance. It uses Exploratory Factor Analysis (EFA) to identify a model and employs Confirmative Factor Analysis (CFA) in a separate dataset to test the degree of model fit. The researcher videotaped ten speeches and ACTFL professional raters assessed the oral…

This study determines the fine-grained bottom-up linguistic features involved in successful second language (L2) English academic group oral tutorial discussion through the use of a spoken learner corpus composed of more than 20 hrs of L2 production. Student performances were graded by teacher-raters using a can-do rating scale, which assessed…

This paper reports a case study of the nature and extent of progress in speaking skills made by a group of upper intermediate instructed learners, and also assessors' perceptions of that progress. Initial and final interview data were analysed using several measures of Grammatical and Lexical Complexity, Language Accuracy and Fluency. These…

Second language (L2) oral performance assessment always involves raters' subjective judgments and is thus subject to rater variability. The variability due to rater characteristics has important consequential impacts on decision-making processes, particularly in high-stakes testing situations (Bachman, Lynch, & Mason, 1995; A. Brown, 1995;…

The lack of consistency in how bilingual language dominance is assessed currently impedes cross-experiment comparisons (Grosjean, 1998). We present a paper-and-pencil dominance scale that can be used to quantify the language dominancy of bilingual participants. The scale targets three main criteria important in gauging dominance (Grosjean, 1998;…

The definition and operationalization of interactional competence in speaking tests that entail co-construction of discourse is an area of language testing requiring further research. This article explores the reactions of four trained raters to paired candidates who oriented to asymmetric patterns of interaction in a discussion task. Through an…

The study reported in this paper is an investigation of the nature of speaking proficiency in English as a second language in the context of a larger project to develop a rating scale for a new international test of English for Academic Purposes, TOEFL iBT (Brown et al. 2005). We report on a large-scale study of the relationship between detailed…

A manual for use in training French and Spanish language examiners at the Foreign Service Institute is presented here. After a discussion of the history of the language proficiency test and of the testing procedure and evaluation techniques, the following topics are covered: (1) language proficiency ratings based on the absolute criterion of the…