The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

This sequential mixed-methods study investigates washback on learning in a high-stakes school exit examination by examining learner perceptions and reported behaviours in relation to learners' beliefs and language learning experience, the role of other stakeholders in the washback mechanism, and socio-educational forces. The focus is the graded…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

There is a growing need for standardized oral assessment rubrics in learning institutions. This is linked to the growing number of ESL learners not only in Saudi Arabia but other parts of the world. To assess the need to use standardized oral assessment rubrics, this particular study explores various peer reviewed articles that support the use of…

The purpose of the present study is to evaluate proficiency tests of the universities in Turkey in line with the ALTE Quality Assurance Checklists in terms of four dimensions: a. Test construction, b. Administration & Logistics c. Grading, Marking Results and d. Test Analysis & Post-examination Review. The study took place in four…

The main goal of this research is to achieve fairer assessment of students' knowledge and skills in tests in view of the fact that learners with similar abilities are often assigned different test grades if their achievements are borderline cases between two grades. As an example, a student who has scored 29 points out of 60 in a test will fail,…

Scoring language learners' speaking skills is open to a number of measurement errors since raters' personal judgements could involve in the process. Different grading designs in which raters score a student's whole speaking skills or a specific dimension of the speaking performance could be settled to control and minimize the amount of the error…

It is acknowledged that assessment ethics is an integral part of teacher education. Unlike sizable published research on students' perceptions of assessment in higher education, very little is reported on student teachers' perceptions of assessment ethics across university-based teacher education programs. This study aimed to explore Teaching…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

Many overseas students in Higher Education in the UK struggle to understand the compulsory texts for their course, and obtain lower scores for their modules than their monolingual peers. While the existence of this achievement gap is well established in the literature, little is known about the ways in which overseas students in HE with limited…

Language assessment literacy (LAL) remains an uncharted area for many English language lecturers, hindering their ability to effectively bridge the gap between theoretical knowledge and practical application in language assessment within the classroom setting. This research aimed to investigate the language assessment literacy of Thai EFL…

This paper compares the speaking scores generated by two online systems that are designed to automatically grade student speech and provide personalized speaking feedback in an EFL context. The first system, "Speech Assessment for Moodle" ("SAM"), is an open-source solution developed by the author that makes use of Google's…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

The English General Scholastic Ability Test (GSAT), a nationwide high-stakes college entrance exam in Taiwan, has commonly served as a placement test for streaming college freshmen into EFL classes. There has, however, been scant research reported on the feasibility of using an admission test for EFL placement. This study aims to investigate the…