ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

The arrival of ChatGPT and other artificial intelligence (AI) has caused considerable concern for educators worldwide, many of whom are still recovering from the impact of the COVID-19 pandemic. Although the debate continues around the use of AI in education, one approach to ensure students are achieving their learning objectives, the oral exam or…

Assessment holds the key to unlocking for the teacher a child's past (what he already knows), present (what he is learning), and future (what he still needs to learn) to inform teaching. Despite the benefits of assessment for informing teaching practice and enhancing student learning, it remains one of the most challenging and time-consuming tasks…

Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends…

The promotion and measurement of standards in compulsory education systems has been a prominent feature of Western education systems for centuries. But the COVID-19 pandemic and the rise of artificial intelligence (AI) have made the limits of current standards-based approaches to assessment more evident. Louis Volante, Don A. Klinger, and…

Introduction: Artificial intelligence (AI) presents challenges and opportunities for higher education. The challenge is to incorporate the benefits of AI while minimizing its potential for misuse and undermining of learning. The opportunity is that AI allows instructors to assess learning authentically by fostering creative, engaging, realistic,…

This chapter presents a critical analysis of generative AI (GenAI) detection tools in higher education assessments. The rapid advancement and widespread adoption of GenAI, particularly in education, necessitates a reevaluation of traditional academic integrity mechanisms. I explore the effectiveness, vulnerabilities, and ethical implications of AI…

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely,…

Purpose: Recent advances in artificial intelligence provide opportunities to capture and represent complex features of human language in a more automated manner, offering potential means of improving the efficiency of language assessment. This review article presents computerized approaches for the analysis of narrative language and identification…

This paper proposes a conceptual framework for integrating Artificial Intelligence (AI) into the curriculum. It builds on previous conceptual papers, which provided initial suggestions on integrating AI into teaching. The approach to developing the conceptual framework includes drawing on existing frameworks, AI literature, and case studies from…

Educational assessment is inherently uncertain, where physiological, psychological and social factors play an important role in establishing judgements which are assumed to be "absolute". AI and other algorithmic approaches to grading of student work strip-out uncertainty, leading to a lack of inspectability in machine judgement and…

This book offers a groundbreaking resource designed to transform how experiential learning is integrated into educational settings across various disciplines. It offers a comprehensive resource for educators and practitioners who are committed to enhancing student engagement and learning outcomes through innovative, practical approaches. The…

Artificial Intelligence (AI) based assessments are commonly used in a variety of settings including business, healthcare, policing, manufacturing, and education. In education, AI-based assessments undergird intelligent tutoring systems as well as many tools used to evaluate students and, in turn, guide learning and instruction. This chapter…

In this paper, we present an agenda for the research directions we recommend in addressing the issues of realizing and evaluating communication in CPS instruments. We outline our ideas on potential ways to improve: (1) generalizability in Human-Human assessment tools and ecological validity in Human-Agent ones; (2) flexible and convenient use of…

Creating assessment questions aligned to standards is a time-consuming task for teachers, but large language models such as ChatGPT can help. Bryan Drost & Char Shryock describe a three-step process for using ChatGPT to create assessments: 1) Ask ChatGPT to break standards into measurable targets. 2) Determine how much time to spend on each…