Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

Background/Context: Early childhood education research has consistently found evidence of immediate, positive effects on developmental outcomes. Despite these strong initial benefits, follow-up analyses often reveal that these effects fadeout in the years following participation (e.g., Bailey et al., 2017, Clements et al., 2013; Lipsey et al.…

Many public and private initiatives have focused on improving prekindergarten (PK) through Grade 12 mathematics education, given that the mathematics content learned before college is foundational for later learning and college success across STEM subjects. Although decades of educational research have studied PK-12 mathematics interventions, the…

This paper describes a cluster-randomized trial of an after-school program intended to build mathematical identity among students in groups under-represented in science, technology, engineering and mathematics (STEM). Populations under-represented in STEM include women, persons with disabilities, African Americans, and Latino/as (NSF, 2011). U.S.…

Several studies suggest that values-affirmation can serve as a simple, yet powerful, tool for dramatically reducing achievement gaps. Because subtle variations in implementation procedures may explain some of the variation in these findings, it is crucial for researchers to measure the fidelity with which interventions are implemented. The authors…

Researchers, policymakers, and educators have long recognized the role of parents in shaping student achievement. A large body of observational studies documents the strong relationship between family background and educational outcomes, but to date there have been very few experimental studies in this area. In this study, the authors offer a…

While the adjusted cohort graduation rate of students in the United States has reached 80 percent during the 2011-12 school year (Stetser & Stillwell, 2014), in the School District of Philadelphia (SDP) only 57% of its students graduate from high school in four years, which is typical of large urban school districts (Swanson, 2009). Moreover,…

School districts are increasingly adopting technology-based resources in an attempt to improve student achievement. This paper reports the two-year results from randomized control trial of Achieve3000 in the Wake County Public School System (WCPSS) in Raleigh, North Carolina. Achieve3000 is an early literacy program that differentiates non-fiction…

Cluster randomized experiments are now widely used to examine intervention effects in prevention science. It is meaningful to use empirical benchmarks for interpreting effect size in prevention science. The effect size (i.e., the standardized mean difference, calculated by the difference of the means between the treatment and control groups,…

Policy changes from the past decade have resulted in a growing interest in identifying effective teachers and their characteristics. This study is the third study to use data from a randomized experiment to test the validity of measures of teacher effectiveness. The authors collected effectiveness measures across three school years from three…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

The objective of this study was to look across strategies used in a wide range of studies to build a framework for researchers to use in conceptualizing the recruitment process. This paper harvests lessons learned across 19 randomized controlled trials in K-12 school settings conducted by a leading research organization to identify strategies that…

To raise math success rates in middle school, many schools and districts have implemented summer math programs designed to improve student preparation for algebra content in grade 8. However, little is known about the effectiveness of these programs. While students who participate typically experience learning gains, there is little rigorous…

The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the…