As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

Noncompliance to treatment assignment is widespread in randomized trials and presents challenges in causal inference. In the presence of noncompliance, the most commonly estimated effect of treatment assignment, also known as the intent-to-treat (ITT) effect, is biased. Of interest in this setting is the complier average causal effect (CACE), the…

This article provides evidence about predictive relationships between features of community college interventions and their impacts on student progress. This evidence is based on analyses of student-level data from large-scale randomized trials of 39 (mostly) community college interventions. Specifically, the evidence consistently indicates that…

Narration has been shown to be a foundational skill for literacy development in school-age children. Elementary teachers routinely conduct classroom lessons that focus on reading decoding and comprehension, but they rarely provide instruction in oral narration (Hall et al., 2021). This multisite randomized controlled trial was designed to…

This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

In this article, Rachel Abenavoli, Natalia Rojas, Rebecca Unterman, Elise Cappella, Josh Wallack, and Pamela Morris argue that research-practice partnerships make it possible to rigorously study relevant policy questions in ways that would otherwise be infeasible. Randomized controlled trials of small-scale programs have shown us that early…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Objective: College students with attention deficit/hyperactivity disorder (ADHD) are at increased risk for numerous educational and psychosocial difficulties. This study reports findings from a large, multisite randomized controlled trial examining the efficacy of a treatment for this population, known as ACCESS -- Accessing Campus Connections and…

A solid understanding of fractions is the cornerstone for acquiring proficiency with rational numbers and paves the way for learning advanced mathematical concepts, such as algebra. Fraction difficulties limit not only students' educational and vocational opportunities but also their ability to solve everyday problems. Students who exit 6th grade…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

A prior cluster randomized controlled trial (RCT) compared outcomes for a comprehensive school intervention (schoolMAX) to typical educational programming (services-as-usual [SAU]) for 103 children with autism spectrum disorder (ASD) without intellectual disability. The schoolMAX intervention was superior to SAU in improving social-cognitive…

Introduction: Youth in disadvantaged urban areas are frequently exposed to chronic stress and trauma, including housing instability, neighborhood violence, and other poverty-related adversities. These exposures increase risk for emotional, behavioral, and academic problems and ultimately, school dropout. Schools are a promising setting in which to…

In basic regression discontinuity (RD) designs, causal inference is limited to the local area near a single cutoff. To strengthen the generality of the RD treatment estimate, a design with multiple cutoffs along the assignment variable continuum can be applied. The availability of multiple cutoffs allows estimation of a pooled average treatment…

Randomized trials are often conducted with separate randomizations across multiple sites such as schools, voting districts, or hospitals. These sites can differ in important ways, including the site's implementation, local conditions, and the composition of individuals. An important question in practice is whether--and under what…

This article summarizes findings from a two-year randomized control trial, focusing on a subset of 194 fourth graders with reading comprehension scores at or below the 15th percentile. Students in the treatment condition received an average of 94 daily 30-min sessions of small group intervention implemented with fidelity by well-trained research…