The current literature on test equating generally defines it as the process necessary to obtain score comparability between different test forms. The definition is in contrast with Lord's foundational paper which viewed equating as the process required to obtain comparability of measurement scale between forms. The distinction between the notions…

Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions and recent work has considered the role of bounding approaches that provide a range of treatment impact…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

In this paper we use historic score-reporting records and test-taker metadata to inform data-driven recommendations that support international students in their choice of undergraduate institutions for study in the United States. We investigate the use of Structural Topic Modeling (STM) as a context-aware, probabilistic recommendation method that…

To demonstrate the sequential nature of the college application process, in this paper I analyze the evolution of applications among high-achieving low-income students through data on the exact timing of SAT score sends. I describe at what point students send scores to colleges and which score sends ultimately become applications, resulting in…

Many of the numbers used to assess students are statistical in nature. The theoretical context underlying the production of a typical number or statistic used in student assessment is presented. The author urges readers to recognize objective data as subjective information and to carefully consider the numbers that often determine admission,…

With so many role-playing simulations already in the political science education literature, the recent repeated calls for new games is both timely and appropriate. This article answers and extends those calls by advocating the creation of probabilistic games using Microsoft Excel. I introduce the example of the Stag Hunt Game--a short, effective,…

College education becomes increasingly important for individuals' career prospect. However, many students enter college academically unprepared (Jackson & Kurlaender, 2014). As a response, high school curriculum is tasked as the gatekeeper of students' academic proficiency that equips students with essential knowledge and skills for…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

Concordance tables have been used for decades to relate scores on different tests measuring similar but distinct constructs. These tables, typically derived from statistical linking procedures, provide a direct link between scores on different tests and serve various purposes. Aside from describing how a score on one test relates to performance on…

Model-based attempts to rigorously study the broad and imprecise concept of "discriminating power" are scarce, and generally limited to nonlinear models for binary responses. This paper proposes a comprehensive framework for assessing the discriminating power of item and test scores which are analyzed or obtained using Spearman's…

The cost of attending college has risen steadily over the past 30 years, making financial aid an important determinant of college choice for many students and a subject of concern for colleges and state governments. In this paper, we estimate the effect of rule-based merit aid assignment on students' enrollment decisions at the University of Iowa.…

This study investigated how population parameters representing heterogeneity of variance, skewness, kurtosis, bimodality, and outlier-proneness, drawn from normal and eleven non-normal distributions, also characterized the ranks corresponding to independent samples of scores. When the parameters of population distributions from which samples were…

This study investigated fast mapping in late-talking (LT) toddlers and toddlers with normal language (NL) development matched on age, nonverbal cognition, and maternal education. The fast-mapping task included novel object labels and familiar words. The LT group scored significantly lower than the NL group on novel word comprehension and…

There are many situations where random assignment of participants to treatment and comparison conditions may be unethical or impractical. This article provides an overview of propensity score techniques that can be used for estimating treatment effects in nonrandomized quasi-experimental studies. After reviewing the logic of propensity score…