This paper discusses the challenges of defining coherence in the context of oral language assessment literacy and proposes that better understanding of the construct can be achieved through a systemic-functional linguistic lens. Coherence is taken to be a foundational quality of written and spoken discourse and is a standard feature in the…

Current L2 utterance fluency literature tends to operationalize disfluency as isolated, individual features. However, disfluency features often co-occur at one location or across multiple locations in one utterance. This study explores the co-occurrence of L2 disfluency features in a speech corpus from 71 L1 and L2 speakers of English across…

Complexity, accuracy, and fluency (CAF) as measures of language proficiency have been used extensively in assessing second language production in English language studies related to task-based language teaching. The present review adds the following critical elements to the existing body of literature: (i) Provides synthesis and critical analysis…

The main aim of this study was to investigate how oral fluency is assessed across different levels of proficiency in the Test of English for Educational Purposes (TEEP). Working with data from 56 test-takers performing a monologic task at a range of proficiency levels (equivalent to approximately levels 5.0, 5.5, 6.5, and 7.5 in the IELTS scoring…

While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

A significant number of students experience anxiety when asked to speak in English. This unease, often rooted in factors such as shyness, lack of confidence, uncertainty, and a lack of motivation, can hinder their active participation during English oral exams. One of the most important goals that every English language teacher should strive to…

This study evaluates the impact of a computer-assisted language learning (CALL) tool for the acquisition of academic English and oral language skills in children learning English as a second language. Using a quasi-experimental design, we compare English proficiency scores for K-5 students who did or did not use the program during the 2020-21…

This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview - Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an…

This study is the first attempt to explore the relationship between rater variables focusing on raters' language aptitude and their judgments of second language (L2) speech. Thirty-four English listeners rated 65 spontaneous native and nonnative speech samples for comprehensibility, accentedness, and fluency. They also completed the LLAMA language…

Language testing research has suggested that placement accuracy can be an important factor in the consequences of placement decision-making. However, previous studies primarily have used a one-shot teacher judgment of placement accuracy, suffering from a lack of students' perspectives of their time-varying experiences. The present study aimed to…

A language 'test' is a systematic procedure for observing a person's behavior and describing it with the aid of a numerical scale or category system (Cronbach LJ 1971: 26). A test cannot be based on a selection of items chosen on linguistic grounds alone, and that to devise an effective test, it is necessary to specify how an examinee requires to…

The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

This study compared the effects of task repetition only (TR), task repetition with grammatizing (TR+GR), and grammatization with no task repetition (GR) on 94 EFL learners' oral task performances. Participants' productions were measured both in terms of complexity, accuracy, and fluency as well as receptive knowledge (measured by an error…

The study aims to investigate the impact of implementing the Numbered Heads Strategy on developing oral expression skills among Arabic learners who speak languages, as well as their attitudes towards this teaching method. The research involved 50 participants, both male and female, at the fourth level of a language center within Al al-Bayt…

This paper represents a summary and discussion of the three studies presented at the morning session of the Fall 2022 JALT Vocabulary SIG. The papers, which were written by Ali Al-Hoorie, Masaki Eguchi, Derek Canning, Stuart McLean, Christopher Nicklin, and Joseph Vitta, represent a range of topics and study designs that are common in recent…