Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

This study sought to identify the challenges and needs of TOEFL iBT candidates in achieving C1 level scores in the speaking and writing sections of the exam. To this end, the researcher employed a mixed-method approach to collect data from a population of 46 students, both male and female, between the ages of 22 and 30. The participants were…

The overarching aim of the study is to explore the extent to which test takers' performances on monologic speaking tasks provide information about their interactional competence. This is an important concern from a test use perspective, as stakeholders tend to consider test scores as providing comprehensive information about all aspects of L2…

This study investigated U.S. undergraduates' perceptions of non-native speakers' (NNS) speech which had received 100% proficiency scores on the TOEFL iBT test. Fifty-five U.S. undergraduates rated 20 speech samples for comprehensibility, accentedness, and acceptability. The speech samples were also analyzed for acoustic fluency. Descriptively,…

This study investigated the constructs underlying second language (L2) word association (WA) with regard to three dimensions of lexical competence--size, organization, and accessibility--and the lexical performance of speech. One-hundred and thirteen Japanese learners of English completed a computer-delivered oral WA task along with three…

Assessing language skills in an integrative form has drawn the attention of assessment experts in recent years. While some research data exists on integrative listening/reading-to-write assessment, there is comparatively little research literature on listening-to-speak integrated assessment. Also, little attention has been devoted to the role of…

Recent technology advancements have increased the prospects for automated spoken language technology to provide feedback on speaking performance. In this study we examined user perceptions of using an automated feedback system for preparing for the TOEFL iBT® test. Test takers and language teachers evaluated three types of machine-generated…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

A key piece of a validity argument for a language assessment tool is clear overlap between assessment tasks and the target language use (TLU) domain (i.e., the domain description inference). The TOEFL 2000 Spoken and Written Academic Language (T2K-SWAL) corpus, which represents a variety of academic registers and disciplines in traditional…

While recent research has shown that multimodal feedback and use of formulaic sequences (FS) are effective in improving student performance on writing tasks, there is a dearth of studies on the impact of these aspects on computer-based academic speaking assessments. This dissertation seeks to fill this gap by examining the impact of both…

This study examines the effect of incorporating a variety of international English accents into a simulated TOEFL listening comprehension test in growing recognition of internationalization of language teaching and learning in the field of TESOL. Although some high-stakes English proficiency exams have begun incorporating speech samples produced…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…

While fluency in second language speaking can be a challenging construct to measure, it is important to identify the discourse features that contribute to it. This small-scale classroom research project examined the effect of formulaic language sequences on fluency as measured by computer-based speaking tasks of young English learners. Thirty-six…

An assumption underlying speaking tests is that scores reflect the ability to produce online, non-rehearsed speech. Speech produced in testing situations may, however, be less spontaneous if extensive test preparation takes place, resulting in memorized or rehearsed responses. If raters detect these patterns, they may conceptualize speech as…

Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for…