This contribution deals with effect measures for covariates in ordinal data models to address the interpretation of the results on the extreme categories of the scales, evaluate possible response styles, and motivate collapsing of extreme categories. It provides a simpler interpretation of the influence of the covariates on the probability of the…

Research in education and behavioral sciences often involves the use of latent variable models that are related to indicators, as well as related to covariates or outcomes. Such models are subject to interpretational confounding, which occurs when fitting the model with covariates or outcomes alters the results for the measurement model. This has…

Grounded within current reform recommendations and built upon Giere's views (1986, 1999) on model-based science, we propose an alternative approach to science education which we refer to as the "Evidence-Explanation (EE) Continuum." The approach addresses conceptual, epistemological, and social domains of knowledge, and places emphasis…

Multilevel factor mixture modeling (FMM) is a hybrid of multilevel confirmatory factor analysis (CFA) and multilevel latent class analysis (LCA). It allows researchers to examine population heterogeneity at the within level, between level, or both levels. This tutorial focuses on explicating the model specification of multilevel FMM that considers…

There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

Recently, there has been increasing interest in comparing educational leadership measures, such as principal school leadership, using International Large-Scale Assessments (ILSAs) data. However, there are doubts about the uniformity of measurement across countries participating in the ILSAs. There are concerns that the robustness and psychometric…

Increasingly, learning in science and mathematics is considered in terms of induction into the multimodal language practices of the disciplinary community. A strong strand of research in this tradition has involved students being challenged to invent multimodal language forms, and their ideas refined through structured guidance. Often, however,…

Longitudinal data analysis has been widely employed to examine between-individual differences in within-individual changes. One challenge of such analyses is that the rate-of-change is only available indirectly when change patterns are nonlinear with respect to time. Latent change score models (LCSMs), which can be employed to investigate the…

We introduce a model which combines principles from psychometric and connectionist paradigms to allow direct Q-matrix refinement via backpropagation. We call this model dAFM, based on augmentation of the original Additive Factors Model (AFM), whose calculations and constraints we show can be exactly replicated within the framework of neural…

Current recommended cutoffs for determining measurement invariance have typically derived from simulation studies that have focused on multigroup confirmatory factor analysis, often using continuous data. These cutoffs may be inappropriate for ordered categorical data in a longitudinal setting. This study conducts two Monte Carlo studies that…

Explanatory item response models (EIRMs) have been applied to investigate the effects of person covariates, item covariates, and their interactions in the fields of reading education and psycholinguistics. In practice, it is often assumed that the relationships between the covariates and the logit transformation of item response probability are…

Explanatory item response models (EIRMs) have been applied to investigate the effects of person covariates, item covariates, and their interactions in the fields of reading education and psycholinguistics. In practice, it is often assumed that the relationships between the covariates and the logit transformation of item response probability are…

In a 1993 book review, E. Pearlstein asks, "Why don't textbook authors begin their discussion of magnetism by talking about magnets? That's what students have experience with." A similar question can be asked, "Why don't professors have students measure the force between permanent magnets in introductory physics labs?" The…

In this ITEMS module, we provide a didactic overview of the specification, estimation, evaluation, and interpretation steps for diagnostic measurement/classification models (DCMs), which are a promising psychometric modeling approach. These models can provide detailed skill- or attribute-specific feedback to respondents along multiple latent…

When practitioners use modern measurement models to evaluate rating quality, they commonly examine rater fit statistics that summarize how well each rater's ratings fit the expectations of the measurement model. Essentially, this approach involves examining the unexpected ratings that each misfitting rater assigned (i.e., carrying out analyses of…