ERIC Number: EJ1462362
Record Type: Journal
Publication Date: 2025
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2155-7098
EISSN: EISSN-2155-7101
Available Date: 0000-00-00
Revolutionising Essay Evaluation: A Cutting-Edge Rubric for AI-Assisted Writing
Hassan Saleh Mahdi; Ahmed Alkhateeb
International Journal of Computer-Assisted Language Learning and Teaching, v15 n1 2025
This study aims to develop a robust rubric for evaluating artificial intelligence (AI)--assisted essay writing in English as a Foreign Language (EFL) contexts. Employing a modified Delphi technique, we conducted a comprehensive literature review and administered Likert scale questionnaires. This process yielded nine key evaluation criteria, forming the initial rubric. The rubric was applied to evaluate 33 AI-assisted essays written by students as part of an intensive course assignment. Statistical analysis revealed significant inter-rater reliability and convergent validity coefficients, supporting the adoption and further development of such rubrics across higher education institutions. The developed rubric was subsequently used to evaluate these essays using two AI tools: ChatGPT and Claude. The results indicated that both AI tools evaluated the essays with similar scores, demonstrating consistency in their assessment capabilities.
Descriptors: Scoring Rubrics, Essays, Writing Evaluation, Artificial Intelligence, Technology Uses in Education, Writing Instruction, English (Second Language), Second Language Learning, Second Language Instruction, Likert Scales, Interrater Reliability, Computer Software, Scores, Delphi Technique, Evaluation Criteria, Persuasive Discourse, Undergraduate Students, Private Colleges, Foreign Countries
IGI Global. 701 East Chocolate Avenue, Hershey, PA 17033. Tel: 866-342-6657; Tel: 717-533-8845; Fax: 717-533-8661; Fax: 717-533-7115; e-mail: journals@igi-global.com; Web site: https://www.igi-global.com/journals/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Saudi Arabia
Grant or Contract Numbers: N/A
Author Affiliations: N/A