Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Measuring change in an educational or psychological construct over time is often achieved by repeatedly administering the same items to the same examinees over time. When the response data are categorical, item response theory (IRT) model can be used as the measurement model of a second-order latent growth model (referred to as LGM-IRT) to measure…

In many modeling contexts, the variables in the model are linear composites of the raw items measured for each participant; for instance, regression and path analysis models rely on scale scores, and structural equation models often use parcels as indicators of latent constructs. Currently, no analytic estimation method exists to appropriately…

Two experiments examined whether concrete models support place value learning. In Experiment 1 (N = 149), 7-year-olds were trained with either a) symbols alone or b) symbols and base-10 blocks. Children in both groups showed significant growth overall, but there were specific effects favoring one training type over another. Symbols-only training…

The last 20 years has seen an uptick in research on missing data problems, and most software applications now implement one or more sophisticated missing data handling routines (e.g., multiple imputation or maximum likelihood estimation). Despite their superior statistical properties (e.g., less stringent assumptions, greater accuracy and power),…

The purpose of this paper is to provide guidance in choice of analytic bias reduction methods for educational studies in which the goal is to estimate a treatment effect in the presence of selection bias into treatment. In addition, issues of dimensionality, collinearity, omitted confounders, missing outcomes, and non-independence may be factors…

Age-period-cohort (APC) models are designed to estimate the independent effects of age, time periods, and cohort membership. However, APC models suffer from an identification problem: There are no unique estimates of the independent effects that fit the data best because of the exact linear dependency among age, period, and cohort. Among methods…

This article examines the possible dependency of composite reliability on presentation format of the elements of a multi-item measuring instrument. Using empirical data and a recent method for interval estimation of group differences in reliability, we demonstrate that the reliability of an instrument need not be the same when polarity of the…

Since Cronbach's (1951) elaboration of a from its introduction by Guttman (1945), this coefficient has become ubiquitous in characterizing assessment instruments in education, psychology, and other social sciences. Also ubiquitous are caveats on the calculation and interpretation of this coefficient. This article summarizes a recent contribution…

Path models with observed composites based on multiple items (e.g., mean or sum score of the items) are commonly used to test interaction effects. Under this practice, researchers generally assume that the observed composites are measured without errors. In this study, we reviewed and evaluated two alternative methods within the structural…

The purpose of this study was to estimate distances from accelerometer-derived Bluetooth signals as a measure of interpersonal spatial proximity. Accelerometer-derived proximity data were collected indoors and outdoors over a 10m range to calibrate simulation models. Proximity data were simulated over 20m (indoor) and 50m (outdoor) ranges.…

Tatsuoka (1984) suggested several extended caution indices and their standardized versions that have been used as person-fit statistics by researchers such as Drasgow, Levine, and McLaughlin (1987), Glas and Meijer (2003), and Molenaar and Hoijtink (1990). However, these indices are only defined for tests with dichotomous items. This paper extends…

In this article, several ways to adjust gross school effects are discussed to set the stage for estimating treatment effects in schooling. Although it is quite hazardous to hypothesize realistic benchmarks for results from meta-analyses, because of the dependency of effect sizes on subject matter area, grade level, and study characteristics, a…

When proportional information is pit against whole number numerical information, children often attend to the whole number information at the expense of proportional information (e.g., indicating 4/9 is greater than 3/5 because 4 > 3). In the current study, we presented younger (3- to 4-year-olds) and older (5- to 6-year-olds) children a task…

Given their capacity to identify causal relationships, experimental audit studies have grown increasingly popular in the social sciences. Typically, investigators send fictitious auditors who differ by a key factor (e.g., race) to particular experimental units (e.g., employers) and then compare treatment and control groups on a dichotomous outcome…