We propose a novel method for automated short answer grading (ASAG) designed for practical use in real-world settings. The method combines LLM embedding similarity with a nonlinear regression function, enabling accurate prediction from a small number of expert-graded responses. In this use case, a grader manually assesses a few responses, while…

Evaluation is an essential component of the learning process when discerning learning situations. Assessing natural language responses, like short answers, takes time and effort. Artificial intelligence and natural language processing advancements have led to more studies on automatically grading short answers. In this review, we systematically…

Open-text responses provide researchers and educators with rich, nuanced insights that multiple-choice questions cannot capture. When reliably assessed, such responses have the potential to enhance teaching and learning. However, scaling and consistently capturing these nuances remain significant challenges, limiting the widespread use of…

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly popular in assisting human graders to reduce their workload. However, LLMs' limitations in domain knowledge…

This review compares generative artificial intelligence with five representative educational technologies in history and concludes that AI technology can become a knowledge producer and thus can be utilized as educative AI to enhance teaching and learning outcomes. From a historical perspective, each technological breakthrough has affected…

The study highlights ChatGPT-4's potential in educational settings for the evaluation of university students' open-ended written examination responses. ChatGPT-4 evaluated 54 written responses, ranging from 24 to 256 words in English. It assessed each response using five criteria and assigned a grade on a six-point scale from fail to excellent,…

In the last two years, there has been a significant increase in research studies on ChatGPT and its role in educational assessment. However, there is no comprehensive systematic literature review (SLR) on the potential use of ChatGPT for educational assessment, particularly with a focus on its practices and limitations. To address this gap, our…

Purpose: The use of generative artificial intelligence (genAi) language models such as ChatGPT to write assignment text is well established. This paper aims to assess to what extent genAi can be used to obtain guidance on how to avoid detection when commissioning and submitting contract-written assignments and how workable the offered solutions…

In postsecondary education institutions, where innovative technologies continually reshape research and pedagogical approaches, the integration of generative artificial intelligence (GenAI) tools presents promising avenues for enhancing student learning experiences. This study assesses the efficacy of integrating GenAI tools, specifically…

The University of Palermo is proud to host the 18th International Conference on Educational Data Mining (EDM) in Palermo, Italy, from July 20 to July 23, 2025. EDM is the annual flagship conference of the International Educational Data Mining Society. This year's theme is "New Goals, New Measurements, New Incentives to Learn." The theme…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

The purpose of this study is to examine the impact of artificial intelligence (AI) on online assessment in the context of opportunities and threats based on the literature. To this end, 19 articles related to the AI tool ChatGPT and online assessment were analysed through rapid literature review. In the content analysis, the themes of "AI's…

The development, use, and timely promotion of Open Education (OE) has been effective in addressing myriad educational concerns, including inclusivity, accessibility and learning achievement, among many others. However, limited information exists in the literature concerning how OE could enhance Generative Artificial Intelligence (GenAI), which is…

Background/purpose: ChatGPT is an artificial intelligence program released in November 2022, but even now, many studies have expressed excitement or concern about its introduction into academia and education. While there are many questions to be asked, the current study reviews the literature in order to reveal the potential effects of ChatGPT on…