Background: Generative artificial intelligence (AI) represents a potentially powerful, time-saving tool for grading student essays. However, little is known about how AI-generated essay scores compare to human instructor scores. Objective: The purpose of this study was to compare the essay grading scores produced by AI with those of human…

Human essay grading is a laborious task that can consume much time and effort. Automated Essay Scoring (AES) has thus been proposed as a fast and effective solution to the problem of grading student writing at scale. However, because AES typically uses supervised machine learning, a human-graded essay corpus is still required to train the AES…

This article examined student experiences before and after an essay writing assignment that required the use of ChatGPT within an undergraduate engineering course. Utilizing a pre-post study design, we gathered data from 24 participants to evaluate ChatGPT's support for both completing and grading an essay assignment, exploring its educational…

In automated essay scoring (AES), scores are automatically assigned to essays as an alternative to grading by humans. Traditional AES typically relies on handcrafted features, whereas recent studies have proposed AES models based on deep neural networks to obviate the need for feature engineering. Those AES models generally require training on a…

WriteRightNow (https://writerightnow.com) is an innovative digital platform meticulously crafted to enhance writing instruction across various curricula. Central to its design is the customization of instructional content, allowing for a multi-faceted approach that caters to diverse student needs, including those with special educational…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

This study conducts a comprehensive analysis of the assessment of journal writing in English as a Foreign Language (EFL) at the secondary school level, comparing the performance of a Generative Artificial Intelligence (GenAI) platform with two human graders. Employing a convergent parallel mixed methods design, quantitative data were collected…

Feedback is powerful but variable. This study investigates which forms of feedback are more predictive of improvement to students' essays, using "Turnitin Feedback Studio"--a computer augmented system to capture teacher and computer-generated feedback comments. The study used a sample of 3,204 high school and university students who…

Electronic feedback given via word-processing software (e.g., track changes in Microsoft Word) allows for a simple way to provide feedback to students during the drafting process. Research has mostly focused on student attitudes toward electronic feedback, with little investigation of how feedback format might affect the quality of instructor…

First year undergraduate design students have found difficulties in realising the standards expected for academic writing at university level. An assessment initiative was used to engage students with criteria and standards for a core interdisciplinary design subject notable for its demanding assessment of academic writing. The same graduate…

Email has become the most preferred form of business communication. Writing "good" email has become an essential skill required in the industry. "Good" email writing not only facilitates clear communication, but also makes a positive impression on the recipient, whether it be one's colleague or a customer. The aim of this paper…

Writing essays and receiving feedback can be useful for fostering students' learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching…

This paper is based on a presentation made at NADE 2016, in Anaheim, California, entitled "Turnitin--An Extraordinary Teaching and Feedback Tool in the Writing Classroom" which discussed the value and benefits of using Turnitin (TII), a subscription-based software/website available to universities that serves as an audio-visual feedback…

Although relatively little attention has been given to the voice assessment of student work, at least when compared with more traditional forms of text-based review, the attention it has received strongly points to a promising form of review that has been hampered by the limits of an emerging technology. A fresh review of voice assessment in light…

The purpose of this study was to investigate problems and potentials of new technologies in English writing education. The effectiveness of automated writing evaluation (AWE) ("MY Access") and of peer evaluation (PE) was compared. Twenty-two English as a foreign language (EFL) learners in Taiwan participated in this study. They submitted…