Knowledge tracing (KT) for evaluating students' knowledge is an essential task in personalized education. More and more researchers have devoted themselves to solving KT tasks, e.g., deep knowledge tracing (DKT), which can capture more sophisticated representations of student knowledge. Nonetheless, these techniques ignore the reconstruction of…

This paper explores assessment approaches within the unique context of Extended Reality (XR) learning environments, which offer immersive and contextualized experiences. Focusing on STEM disciplines, the paper presents four distinctive XR-based assessment cases, exploring the discipline, context, purpose, and results of each. These insights aim to…

Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

A critically important balance in educational measurement between practical concerns and matters of technique has atrophied in recent decades, and as a result, some important issues in the field have not been adequately addressed. I start with the work of E. F. Lindquist, who exemplified the balance that is now wanting. Lindquist was arguably the…

This book addresses the distance between contemporary philosophical critiques of education and the classroom context by applying new insights from social philosophy, neurology and historical analysis to common school practices. Critiquing contemporary academic and political debates concerning the use, and misuse, of assessment tools, psychometric…

Errors that occasionally manifest in examination papers and other educational assessment instruments can threaten reliability and validity. For example, a multiple choice question could have two correct response options, or a geography question containing an inaccurate map could be unanswerable. In this paper we explore this oft-neglected element…

Through this point-of-departure paper we aim to prompt discussion and action around redesigning university learning to help students tackle climate-related challenges in a personally and societally meaningful way. We use the lens of assessment to draw attention to how discipline areas without an explicit environmental or climate science focus can…

The focus of this review paper is on the assessment of English Language Learners (ELLs) and the ways in which the language gap negatively influences ELLs in classroom assessments. The research body provides an outline of differentiated instruction and assessment highlighting the primary obstacles that hinder ELLs from achieving success in various…

Comparative judgment is gaining popularity as an assessment tool, including for high-stakes testing purposes, despite relatively little research on the use of the technique. Advocates claim two main rationales for its use: that comparative judgment is valid because humans are better at comparative than absolute judgment, and because it distils the…

The George Mason University (Mason) offices responsible for institutional reporting and assessment were merged to strengthen and solidify their functions and expertise. The organizational structure creating the Office of Institutional Effectiveness and Planning (OIEP) was intended to engineer a new paradigm where assessment would inform the…

This article examines the role and pedagogical implications of supportive assessment strategies at the interface where curriculum, general "Didaktik" and pedagogy meet; theoretically, the article draws upon concepts from research in each of those domains. This interplay is examined in relation to the performance-orientation on two…

We have dramatically advanced our ability to create rich, complex, and effective assessments across a range of uses through technology advancement. Artificial Intelligence (AI) enabled assessments represent one such area of advancement--one that has captured our collective interest and imagination. Scientists and practitioners within the domains…

This article provides a history of the two large-scale assessment consortia that were funded in 2010 as part of the Race to the Top Competition, the Partnership for the Assessment of Readiness for College and Career (PARCC), and the Smarter-Balanced Assessment Consortium (SBAC). I compare the goals the consortia were funded to meet between 2011…

The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…

Decision-makers in school psychology are presently engaged in the process of determining how to, if possible, move forward with conducting mandated psychoeducational evaluations of students in schools during the pandemic. Whereas prominent organizations within the profession (e.g., American Psychological Association, National Association of School…