Considerable thought is often put into designing randomized control trials (RCTs). From power analyses and complex sampling designs implemented preintervention to nuanced quasi-experimental models used to estimate treatment effects postintervention, RCT design can be quite complicated. Yet when psychological constructs measured using survey scales…

Background: Randomised controlled trials (RCTs) have long been considered the gold standard in education research. Federal funds are allocated to evaluations that meet What Works Clearinghouse standards; RCT designs are required in order to meet these standards without reservations. Schools seek out interventions that are research based, in other…

Purpose: Individual-randomized trials are the gold standard for testing the efficacy and effectiveness of drugs, devices, and behavioral interventions. Health care delivery, educational, and programmatic interventions are often complex, involving multiple levels of change and measurement precluding individual randomization for testing.…

This article provides evidence about predictive relationships between features of community college interventions and their impacts on student progress. This evidence is based on analyses of student-level data from large-scale randomized trials of 39 (mostly) community college interventions. Specifically, the evidence consistently indicates that…

Many randomized controlled trials have investigated the role of school-based prevention interventions to reduce symptoms of anxiety and depression in young people. Systematic reviews have subsequently demonstrated a small, beneficial effect of these interventions when compared to a combined control group including usual care, no intervention, or…

Narration has been shown to be a foundational skill for literacy development in school-age children. Elementary teachers routinely conduct classroom lessons that focus on reading decoding and comprehension, but they rarely provide instruction in oral narration (Hall et al., 2021). This multisite randomized controlled trial was designed to…

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small samples. However, often experimental samples and/or treatment effects are small, A/B tests are underpowered,…

Background: Randomised trials have been on the rise in social policy over the last decade and a half, particularly in areas working with young people and vulnerable adults. Informed consent is an important principle for ethics committees governing research conducted by universities. Aims and objectives: We consider the arguments for and against…

Over the last twenty years, education researchers have increasingly conducted randomised experiments with the goal of informing the decisions of educators and policymakers. Such experiments have generally employed broad, consequential, standardised outcome measures in the hope that this would allow decisionmakers to compare effectiveness of…

When studies use different scales to measure continuous outcomes, standardised mean differences (SMD) are required to meta-analyse the data. However, outcomes are often reported as endpoint or change from baseline scores. Combining corresponding SMDs can be problematic and available guidance advises against this practice. We aimed to examine the…

Purpose: This study examines how ultrasound biofeedback and intensive treatment distribution affect speech sound generalization during an evidence-based treatment, Speech Motor Chaining, for children with persisting speech errors associated with childhood apraxia of speech (CAS). Method: In a 2 × 2 factorial randomized controlled trial, children…

Background: Mission US is a series of interactive first-person role-playing history games and curricular materials that address a critical problem: students lack fundamental knowledge of our nation's history. According to the most recent National Assessment of Educational Progress (NAEP, 2018), only 13% of Grade 8 students were proficient on the…

Purpose: In a companion paper, we found no statistical reason to favor percentage syllables stuttered (%SS) over parent-reported stuttering severity as a primary outcome measure for clinical trials of early stuttering. Hence, considering the logistical advantages of the latter measure, we recommended parent-reported stuttering severity for use as…

This article discusses estimation of average treatment effects for randomized controlled trials (RCTs) using grouped administrative data to help improve data access. The focus is on design-based estimators, derived using the building blocks of experiments, that are conducive to grouped data for a wide range of RCT designs, including clustered and…

Background: When RCTs are not feasible and time series data are available, panel data methods can be used to estimate treatment effects on outcomes, by exploiting variation in policies and conditions over time and across locations. A complication with these methods, however, is that treatment timing often varies across the sample, for example, due…