We propose a novel method for automated short answer grading (ASAG) designed for practical use in real-world settings. The method combines LLM embedding similarity with a nonlinear regression function, enabling accurate prediction from a small number of expert-graded responses. In this use case, a grader manually assesses a few responses, while…

Formative assessment plays a critical role in improving learning outcomes by providing feedback on student mastery. Open-ended questions, which require students to produce multi-word, nontrivial responses, are a popular tool for formative assessment as they provide more specific insights into what students do and do not know. However, grading…

Programming demands a variety of cognitive skills, and mastering these competencies is essential for success in computer science education. The importance of formative feedback is well acknowledged in programming education, and thus, a diverse range of techniques has been proposed to generate and enhance formative feedback for programming…

Recent advances in AI have opened the door for the automated scoring of open-ended math problems, which were previously much more difficult to assess at scale. However, we know that biases still remain in some of these algorithms. For example, recent research on the automated scoring of student essays has shown that certain varieties of English…

Open-text responses provide researchers and educators with rich, nuanced insights that multiple-choice questions cannot capture. When reliably assessed, such responses have the potential to enhance teaching and learning. However, scaling and consistently capturing these nuances remain significant challenges, limiting the widespread use of…

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly popular in assisting human graders to reduce their workload. However, LLMs' limitations in domain knowledge…

This review compares generative artificial intelligence with five representative educational technologies in history and concludes that AI technology can become a knowledge producer and thus can be utilized as educative AI to enhance teaching and learning outcomes. From a historical perspective, each technological breakthrough has affected…

The study highlights ChatGPT-4's potential in educational settings for the evaluation of university students' open-ended written examination responses. ChatGPT-4 evaluated 54 written responses, ranging from 24 to 256 words in English. It assessed each response using five criteria and assigned a grade on a six-point scale from fail to excellent,…

In the last two years, there has been a significant increase in research studies on ChatGPT and its role in educational assessment. However, there is no comprehensive systematic literature review (SLR) on the potential use of ChatGPT for educational assessment, particularly with a focus on its practices and limitations. To address this gap, our…

The University of Palermo is proud to host the 18th International Conference on Educational Data Mining (EDM) in Palermo, Italy, from July 20 to July 23, 2025. EDM is the annual flagship conference of the International Educational Data Mining Society. This year's theme is "New Goals, New Measurements, New Incentives to Learn." The theme…