Background: Automatically graded programming assignments provide instant feedback to students and significantly reduce manual grading time for instructors. However, creating comprehensive suites of test cases for programming problems within automatic graders can be time-consuming and complex. The effort needed to define test suites may deter some…

Background: Artificial intelligence, particularly natural language processing (NLP), enables automating the formative assessment of written task solutions to provide adaptive feedback automatically. A laboratory study found that, compared with static feedback (an expert solution), adaptive feedback automated through artificial neural networks…

Background: Over the past few decades, the process and methodology of automatic question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the generation of educational content. Objectives: This paper explores the potential of large language models…

Background: The recent advent of powerful, exam-passing large language models (LLMs) in public awareness has led to concerns over students cheating, but has also given rise to calls for including or even focusing education on LLMs. There is a perceived urgency to react immediately, as well as claims that AI-based reforms of education will lead to…

Background: When learning causal relations, completing causal diagrams enhances students' comprehension judgements to some extent. To potentially boost this effect, advances in natural language processing (NLP) enable real-time formative feedback based on the automated assessment of students' diagrams, which can involve the correctness of both the…

Artificial Intelligence is at the heart of modern society with computers now capable of making process decisions in many spheres of human activity. In education, there has been intensive growth in systems that make formal and informal learning an anytime, anywhere activity for billions of people through online open educational resources and…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Background: Collaborative problem solving (CPS) is important for success in the 21st century, especially for teamwork and communication in technology-enhanced environments. Measurement of CPS skills has emerged as an essential aspect in educational assessment. Modern research in CPS relies on theory-driven measurements that are usually carried out…

Background: Learners' writing skills are critical to their academic and professional development. Previous studies have shown that learners' self-assessment during writing is essential for assessing their writing products and monitoring their writing processes. However, conducting practical self-assessments of writing remains challenging for…