This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

Scoring language learners' speaking skills is open to a number of measurement errors since raters' personal judgements could involve in the process. Different grading designs in which raters score a student's whole speaking skills or a specific dimension of the speaking performance could be settled to control and minimize the amount of the error…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

We study if the Italian school system suffers from gender bias when judging students. To this aim, we use a differences-in-differences approach that compares the teachers' assessments and the standardized test scores that the students receive during the school year. We have census data for all Italian fifth and sixth graders in two different…

The present study aimed at investigating whether academic IELTS candidates perform differently in writing on either a chart topic or a table topic of the IELTS writing task 1 with regard to the four IELTS writing marking criteria i.e. task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study adopted a…

In the high-stakes accountability English educational system, decisions made by government and agencies about curriculum, pedagogy and assessment drive school planning and actions. This paper analyses the drivers for the recent change to French German and Spanish GCSEs and highlights particular areas of the new specification which may damage the…

Each year the National Reference Test (NRT) reports the proportions of students achieving at or above three key GCSE grades in English and mathematics. The NRT is therefore uniquely placed as a Key Stage 4 assessment which compares performance directly at ability level, to contribute to the evidence on the impact of disruption to education due to…

Background: Marking of essays is mainly carried out by human raters who bring in their own subjective and idiosyncratic evaluation criteria, which sometimes lead to discrepancy. This discrepancy may in turn raise issues like reliability and fairness. The current research attempts to explore the evaluation criteria of markers on a national level…

The minimal-marking project conducted in Ryerson's School of Journalism throughout 2012 and early 2013 resulted in significantly higher grammar scores in two first-year classes of minimally marked university students when compared to two traditionally marked classes. The "minimal-marking" concept (Haswell, 1983), which requires…

A comparison of the French language proficiency of high school students taking the Advanced Placement (AP) Examination for French against college students in their sixth semester of French study found that the college students did slightly less well than the high school students. AP grading standards were more stringent than those used by college…

In Czechoslovakia and the Soviet Union, foreign language tests have been used rarely in schools, because more traditional oral and written examinations are preferred. However, recent changes in socialist pedagogical theory support a trend toward increasing efficiency in the instructional process, increased use of diagnostics, development of more…