I. Purpose of the Study: Detecting whether interventions work or not (through main effect analysis) can provide empirical evidence regarding the causal linkage between malleable factors (e.g., interventions) and learner outcomes. In complement, moderation analyses help delineate for whom and under what conditions intervention effects are most…

Background: The data revolution in education has led to more data collection, more randomized controlled trials (RCTs), and more data collection within RCTs. Often following IES recommendations, researchers studying program effectiveness gather data on how the intervention was implemented. Educational implementation data can be complex, including…

Background: Over the past decade, schools across the United States increasingly turned to online learning (Gemin, Pape, Vashaw, & Watson, 2015; Queen & Lewis, 2011). While many espouse the promise of online credit recovery (OCR) courses, the abrupt shift to online learning during the COVID-19 pandemic renewed concerns about theses courses'…

Background: Poverty-related disparities in school readiness are well documented (Dreyer, 2020). Increasing cognitively stimulating parenting practices can contribute greatly to addressing such disparities, and therefore represent a key modifiable target for preventive interventions beginning early in life (Brooks-Gunn & Markman, 2005).…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

Background/Context: Early childhood education research has consistently found evidence of immediate, positive effects on developmental outcomes. Despite these strong initial benefits, follow-up analyses often reveal that these effects fadeout in the years following participation (e.g., Bailey et al., 2017, Clements et al., 2013; Lipsey et al.…

This paper describes a cluster-randomized trial of an after-school program intended to build mathematical identity among students in groups under-represented in science, technology, engineering and mathematics (STEM). Populations under-represented in STEM include women, persons with disabilities, African Americans, and Latino/as (NSF, 2011). U.S.…

Researchers, policymakers, and educators have long recognized the role of parents in shaping student achievement. A large body of observational studies documents the strong relationship between family background and educational outcomes, but to date there have been very few experimental studies in this area. In this study, the authors offer a…

Little research has been conducted on unconditional cash transfers (UCTs) despite their growing prevalence in Africa, including South Africa, Zambia, Zimbabwe, Kenya, Malawi, Lesotho, and Uganda. In this study, researchers implemented a randomized control trial with over 2,500 households to investigate the impact of Africa's child grant program on…

The objective of this meta-analysis is to rigorously assess the participant effects of private school vouchers, or in other words, to estimate the average academic impacts that the offer (or use) of a voucher has on a student. This review adds to the literature by being the first to systematically review all Randomized Control Trials (RCTs) in an…

While the adjusted cohort graduation rate of students in the United States has reached 80 percent during the 2011-12 school year (Stetser & Stillwell, 2014), in the School District of Philadelphia (SDP) only 57% of its students graduate from high school in four years, which is typical of large urban school districts (Swanson, 2009). Moreover,…

School districts are increasingly adopting technology-based resources in an attempt to improve student achievement. This paper reports the two-year results from randomized control trial of Achieve3000 in the Wake County Public School System (WCPSS) in Raleigh, North Carolina. Achieve3000 is an early literacy program that differentiates non-fiction…

Cluster randomized experiments are now widely used to examine intervention effects in prevention science. It is meaningful to use empirical benchmarks for interpreting effect size in prevention science. The effect size (i.e., the standardized mean difference, calculated by the difference of the means between the treatment and control groups,…

As demand for skilled labor increases, policymakers in an increasing number of developing countries have turned toward vocational education and training (VET) to educate and prepare students. The United Nations Educational, Scientific and Cultural Organization (UNESCO) published a 2012 report "acknowledging the need for [VET] to contribute to…