In the wake of the French Revolution and the failure of subsequent governments to enact humanistic reforms, Schiller observed in frustration that "a great moment has found a little people…" As we emerge from a once-in-a-century pandemic, navigating crisis after crisis amidst uncertainty and instability, it is easy to sympathize with…

In this digital ITEMS module, Dr. Jeffrey Harring and Ms. Tessa Johnson introduce the linear mixed effects (LME) model as a flexible general framework for simultaneously modeling continuous repeated measures data with a scientifically defensible function that adequately summarizes both individual change as well as the average response. The module…

Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

Recent research in multidimensional item response theory has introduced within-item interaction effects between latent dimensions in the prediction of item responses. The objective of this study was to extend this research to bifactor models to include an interaction effect between the general and specific latent variables measured by an item.…

Cognitive diagnosis models (CDMs) are an increasingly popular method to assess mastery or nonmastery of a set of fine-grained abilities in educational or psychological assessments. Several inference techniques are available to quantify the uncertainty of model parameter estimates, to compare different versions of CDMs, or to check model…

Drawing upon his experience, more than 60 years ago, as a psychometric support person to a very special teacher of brain damaged children, the author of this article reflects on the productive use of educational assessments and data from them to educate - assessment in the service of learning. Findings from the Gordon Commission on the Future of…

Traditional assessment in international sports communication is often fragmented and subjective, limiting timely, learner-centered feedback. This study presents a curriculum framework enhanced by generative artificial intelligence, coupled with a deep learning (DL) model for instructional effectiveness assessment in international sports…

Fair educational assessment in linguistically diverse contexts poses new challenges which call for the need to evaluate the impact of context-related language factors on student performance. Based on data from the Basque Autonomous Community in Spain, this research analyses the effect of different factors on a mathematics achievement test. Using…

In this commentary on this issue's focus article by Baird et al., Pellegrino focuses first on the fundamental nature of educational assessment and its connection to theories, models, and data on learning. He then discusses the contemporary views of learning in the form of learning progressions as they relate to assessment development. In the third…

The common practice for testing measurement invariance is to constrain parameters to be equal over groups, and then evaluate the model-data fit to reject or fail to reject the restrictive model. Posterior predictive checking (PPC) provides an alternative approach to evaluating model-data discrepancy. This paper explores the utility of PPC in…

The acquisition of skills amongst learners is integral for their survival. This is the reason why most of the pedagogies integrate them as part of the core learning objectives. However, the advent of technology has revolutionized teaching approaches as well as skills training. Many of the skills in 21st century education highlight ingenuity,…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

This study aims to develop a competitiveness assessment index for global aviation training organizations. The study utilizes the four factors of the Diamond model developed by Michael Porter. To select candidate indices, expert consultations were made, and two stages of Delphi survey were conducted on 24 experts in the area of global aviation…

This article focuses on a family of restricted latent structure models with wide applications in psychological and educational assessment, where the model parameters are restricted via a latent structure matrix to reflect prespecified assumptions on the latent attributes. Such a latent matrix is often provided by experts and assumed to be correct…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…