In recent years, harmonic regression models have been applied to implement quality control for educational assessment data consisting of multiple administrations and displaying seasonality. As with other types of regression models, it is imperative that model adequacy checking and model fit be appropriately conducted. However, there has been no…

Testlets bring several perks in the development and administration of tests, such as 1) the construction of meaningful test items, 2) the avoidance of non-relevant context exposure, 3) the improvement of testing efficiency, and 4) the progression of testlet items requiring higher thinking skills. Thus, the inclusion of testlets in educational…

Cognitive diagnosis models (CDMs) have gained increasing popularity recently because of their potential to provide diagnostic inferences that can inform learning and teaching. However, the development of cognitive diagnostic assessments (CDAs) is lagging behind the development of the associated psychometric models. At present, it is not clear…

This article considers the value of honors education beyond its marked contributions to enrollment management goals. Suggesting that quantitative assessments toward understanding the value of honors fail to capture its breadth, interdisciplinary focus, and engagement, authors posit a new way of measuring impacts from "contagion model"…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

Purpose: Higher education institutions are required to evaluate program quality through cyclical program review processes. Despite often being considered the "gold standard" of academic review, there persists dissatisfaction with the lack of integration of program review findings into other planning processes, such as budgeting,…

This brief article introduces the topic of intelligence as highly appropriate for educational measurement professionals. It describes some of the uses of intelligence tests both historically and currently. It argues why knowledge of intelligence theory and intelligence testing is important for educational measurement professionals. The articles…

In this opinion piece, we explore the idea that GenAI has the potential to fundamentally disrupt computer science education (CSE) by drawing insights from 10 pedagogical and cognitive theories and models. We highlight how GenAI improves CSE by making educational practices more effective and requires less effort and time, and all at a lower cost,…

There is increased use of Bayesian networks (BN) in educational assessment. In psychometrics, BN serves as a measurement model with high flexibility, suitable to model educational assessment data with a complex structure. BN is a novel psychometric approach and not all aspects of its application are well-known. The article aims to provide the…

This paper investigated the integration of a Lesson Study Model (LSM) into distance STEM education during the COVID-19 pandemic. The study focused on six dimensions: (1) STEM education in distance learning, (2) Lesson Study (LS), (3) lesson planning processes, (4) challenges of lesson planning, (5) evaluation and assessment methods, and (6)…

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel's item response theory…

Sociology faculty are accountable to multiple stakeholders to demonstrate that our academic programs are effective and that students are learning. Despite the ubiquity of mandated program review practices, which often include the assessment of student learning, research is lacking on the extent to which these efforts lead to improvements in…

This article critically reviews how diagnostic models have been conceptualized and how they compare to other approaches used in educational measurement. In particular, certain assumptions that have been taken for granted and used as defining characteristics of diagnostic models are reviewed and it is questioned whether these assumptions are the…

Designs combining different types of data are increasingly used in educational evaluation, to provide both evidence of impact and an explanation of the processes by which impacts are created. Logic models are visual representations of how an intervention leads via a set of steps from resources and inputs to outputs and then sets of outcomes. Their…

In this digital ITEMS module, we introduce the framework of nonparametric item response theory (IRT), in particular Mokken scaling, which can be used to evaluate fundamental measurement properties with less strict assumptions than parametric IRT models. We walk through the key distinction between parametric and nonparametric models, introduce the…