Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

Background: An efficacy study based on a randomized controlled trial (RCT) was designed to evaluate the impact of ASSISTments on math learning among middle school students, including those from high-needs rural schools. Despite extensive recruitment efforts in 2021 (during the pandemic), only a few schools and their teachers agreed to participate,…

This is a technical report detailing the analytic methods used to assess the effects of a virtual professional learning community (vPLC)-enhanced ASSISTments intervention. The report uses a quasi-experimental design and partially nested regression model to account for clustering and reveals that while overall effects were positive but not…

Objective: College students with attention deficit/hyperactivity disorder (ADHD) are at increased risk for numerous educational and psychosocial difficulties. This study reports findings from a large, multisite randomized controlled trial examining the efficacy of a treatment for this population, known as ACCESS -- Accessing Campus Connections and…

Early intervention efforts have been effective in reducing disruptive behaviors and the probability of poor developmental outcomes. Early interventions include common practice elements to improve social functioning and decrease problem behaviors that disrupt the teaching-learning process. The First Step Next intervention has been well validated…

Medical research is held as a field for education to emulate. Education researchers have been urged to adopt randomized controlled trials, a more "scientific" research method believed to have resulted in the advances in medicine. But a much more important lesson education needs to borrow from medicine has been ignored. That is the study…

Programs for domestic violence (DV) victims and their families have grown exponentially over the last four decades. The evidence demonstrating the extent of their effectiveness, however, often has been criticized as stemming from studies lacking scientific rigor. A core reason for this critique is the widespread belief that credible evidence can…

Relevance interventions have shown a great potential to foster motivation and achievement (Lazowski & Hulleman, 2016). Yet, further research is warranted to test how such interventions can be successfully implemented in practice. We conducted a cluster-randomized trial in ninth-grade math classrooms to test the effectiveness of a relevance…

The primary objective of the proposed systematic review is to answer the following research question: do parenting programmes for parents of adolescents impact adolescent mental health outcomes, positive development and the parent-adolescent relationship? This will be achieved by systematically searching for and synthesising the extant evaluation…

Three generations of developmental epidemiologically based randomized field trials of the Good Behavior Game (GBG) have been delivered to Baltimore elementary schools. With the collaboration of family and community partners, all three trials were directed at decreasing proximal targets of aggressive behavior and improving learning in first-grade…

Analyses were conducted with second graders, drawn from an ongoing multi-cohort randomized controlled trial (RCT), who had been identified for RCT entry based on comorbid reading comprehension and word-problem solving difficulty. To estimate pandemic learning loss, we contrasted fall performance for 3 cohorts: fall of 2019 (pre-pandemic; n = 47),…

In the 2016-2017 school year, the Liberian government launched Partnership Schools For Liberia (PSL), a pilot program in which the management of 93 primary schools was transferred to 8 private contractors. The pilot owed much to the importation of western policy models and was facilitated by the British organisation ARK and involved BIA, a private…

Poor program implementation constitutes one explanation for null results in trials of educational interventions. For this reason, researchers often collect data about implementation fidelity when conducting such trials. In this article, we document whether and how researchers report and measure program fidelity in recent cluster-randomized trials.…

Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…