In 2015, Wisconsin began mandating the ACT college entrance exam and the WorkKeys career readiness assessment. With population-level data and several quasi-experimental designs, we assess how this policy affected college attendance. We estimate a positive policy effect for middle/high-income students, no effect for low-income students, and greater…

Investigators often rely on the proportion of correct responses in an assessment when describing the impact of early mathematics interventions on child outcomes. Here, we propose a shift in focus to the relative sophistication of problem-solving strategies and offer methodological guidance to researchers interested in working with strategies. We…

Fluent conversation requires temporal organization between conversational exchanges. By performing a systematic review and Bayesian multi-level meta-analysis, we map the trajectory of infants' turn-taking abilities over the course of early development (0 to 70 months). We synthesize the evidence from 26 studies (78 estimates from 429 unique…

Large-scale education data are collected via complex sampling designs that incorporate clustering and unequal probability of selection. Multilevel models are often utilized to account for clustering effects. The probability weighted approach (PWA) has been frequently used to deal with the unequal probability of selection. In this study, we examine…

Previous research indicates that long-term memory (LTM) may contribute to performance in working memory (WM) tasks. Across 3 experiments, we investigated the extent to which active maintenance in WM can be replaced by relying on information stored in episodic LTM, thereby freeing capacity for additional information in WM. First, participants…

Bayesian latent change score modeling (LCSM) was used to compare models of triannual (fall, winter, spring) change on elementary math computation and concepts/applications curriculum-based measures. Data were collected from elementary students in Grades 2-5, approximately 700 to 850 students in each grade (47%-54% female; 78%-79% White, 10%-11%…

New knowledge tracing models are continuously being proposed, even at a pace where state-of-the-art models cannot be compared with each other at the time of publication. This leads to a situation where ranking models is hard, and the underlying reasons of the models' performance -- be it architectural choices, hyperparameter tuning, performance…

Firms desire graduates capable of executing current and future business practices, many of which revolve around data. To meet those needs, we shifted the orientation of our required information systems course from technology to data. Instead of a survey of information systems, students learn the data acquisition-preparation-mining-presentation…

Purpose: Bayesian multilevel models are increasingly used to overcome the limitations of frequentist approaches in the analysis of complex structured data. This tutorial introduces Bayesian multilevel modeling for the specific analysis of speech data, using the brms package developed in R. Method: In this tutorial, we provide a practical…

Despite the broad appeal of missing data handling approaches that assume a missing at random (MAR) mechanism (e.g., multiple imputation and maximum likelihood estimation), some very common analysis models in the behavioral science literature are known to cause bias-inducing problems for these approaches. Regression models with incomplete…

With the growing attention on large-scale educational testing and assessment, the ability to process substantial volumes of response data becomes crucial. Current estimation methods within item response theory (IRT), despite their high precision, often pose considerable computational burdens with large-scale data, leading to reduced computational…

Background: We have previously presented two educational interventions aimed to diminish causal illusions and promote critical thinking. In both cases, these interventions reduced causal illusions developed in response to active contingency learning tasks, in which participants were able to decide whether to introduce the potential cause in each…

A number of studies have found evidence for the so-called "ambiguity advantage," that is, faster processing of ambiguous sentences compared with unambiguous counterparts. While a number of proposals regarding the mechanism underlying this phenomenon have been made, the empirical evidence so far is far from unequivocal. It is compatible…

Research questions regarding how, for whom, and where a treatment achieves its effect on an outcome have become increasingly valued in substantive research. Such questions can be answered by causal moderated mediation analysis, which assesses the heterogeneity of the mediation mechanism underlying the treatment effect across individual and…

Unforeseen complications during the administration of large-scale testing programs are inevitable and can prevent examinees from accessing all test material. For classification tests in which the primary purpose is to yield a decision, such as a pass/fail result, the current study investigated a model-based standard error approach, Bayesian…