In this commentary, we complement other constructive critiques of educational randomized control trials (RCTs) by calling attention to the commonly ignored role of context in causal mechanisms undergirding educational phenomena. We argue that evidence for the central role of context in causal mechanisms challenges the assumption that RCT findings…

This paper considers recent efforts to conduct experimental and quasi-experimental evaluations of career and technical education programs. It focuses on understanding the counterfactual, or control population, for these program evaluations, discussing how the educational experiences of the control population might vary from those of the treated…

Previous randomized-controlled trials have shown that a peer learning group intervention for career preparation can have positive effects on adolescent career management and the transition to post-comprehensive education in secondary schools. However, this earlier evidence of efficacy has been found by intervention studies that have implemented…

Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts may…

Elopement is a common and dangerous concern in autism spectrum disorder (ASD). There is evidence that behavior analytic treatments can successfully treat elopement, but the research is limited due to small samples and treatment components varying across studies. The current study evaluated the feasibility of studying a manualized intervention for…

When a researcher tests an educational program, product, or policy in a randomized controlled trial and detects a significant effect on an outcome, the intervention is usually classified as something that "works." When expected effects are not found, there is seldom an orderly and transparent analysis of plausible reasons why.…

A single-blind randomised control trial investigated the effectiveness of the Learn, Engage and Play (LEaP) playgroup. Seventy-one children with developmental delay were randomly allocated to an 8-week LEaP playgroup or control group and followed up at 12 and 28 weeks. On the primary outcome measure, LEaP demonstrated significant within group…

Participant attrition is a significant challenge for longitudinal studies, particularly those involving disadvantaged populations. We attempted to re-engage n = 990 families in a five-year follow-up of a randomised controlled trial of an early childhood parenting intervention. Tracing was attempted for n = 90/990 (9.1%) uncontactable participants.…

This study investigates the impact of Education Endowment Foundation (EEF)-funded trials on pupils eligible for free school meals. Although similar analysis is conducted during each individual evaluation, this report conducts a meta-analysis using data from 88 trials and over half a million pupils to reach conclusions. The report contributes to…

Although advances have been made in facilitating the implementation of evidence-based treatments, little is known about the most effective way to sustain their use over time. The current study examined the sustainability of one evidence-based treatment, Parent-Child Interaction Therapy (PCIT), following a statewide implementation trial testing…

Empowerment is a core construct in health behavior and an emerging trend in pediatrics. Although it has been suggested as an approach that may promote the person's participation in health care decisions and positive outcomes, little is known about the nature and effectiveness of interventions to support empowerment in families and preschool-age…

Technology-assisted parent-mediated interventions improve accessibility and are acceptable but not proven to be effective. We conducted a systematic search of 6 databases. We included and analysed results from studies on social and communication outcomes. Sixteen Randomised-Controlled-Trials (RCTs) with 748 participants were included. Most studies…

In 2015, Abt Associates received a grant from the Institutes for Education Sciences (IES) for a five-year "Development and Innovation" study of PTC. The purposes of the study were to gauge progress in implementing PTC and to develop and test improvements where needed. Fein et al. (2020) summarize the IES study's approach and findings. A…

We conducted a systematic review to identify randomized controlled trials (RCTs) and single case research design (SCRD) studies of children with autism spectrum disorder that evaluate the effectiveness of responsivity intervention techniques for improving prelinguistic and/or language outcomes. Mean effect sizes were moderate and large for RCTs…

During drug development, a biomarker is sometimes identified as separating a patient population into those with more and those with less benefit from evaluated treatments. Consequently, later studies might be targeted, while earlier ones are performed in mixed patient populations. This poses a challenge in evidence synthesis, especially if only…