Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

This paper describes a 12-week cluster randomized controlled trial that examined the efficacy of BookNook, a virtual tutoring platform focused on reading. Cohorts of first- through fourth-grade students attending six Rocketship public charter schools in Northern California were randomly assigned within grades to receive BookNook. Intent-to-Treat…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

This paper describes the context, processes and issues experienced over 5 years in which a RCT was carried out to evaluate a programme for children aged 7-8 who were struggling with their reading. Its specific aim is to illuminate questions about the design of complex teaching approaches and their evaluation using an RCT. This covers the early…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

The significance of a process evaluation for understanding randomised controlled trials (RCTs) of complex teaching interventions in a classroom setting is discussed in relation to the evaluation of the Integrated Group Reading (IGR) programme trial. This process evaluation is based on realist principles and draws on different data sources. The…

This paper presents findings from a systematic literature review that explored the delivery arrangements of school-based reading interventions for struggling readers aged 5-8 years. Databases were searched for published and unpublished studies from 1970 to 2017, which employed a randomised controlled trial or quasi-experimental design. Sixty-four…

RAND Europe evaluated the implementation of a technology-based intervention that made use of the Microsoft Immersive Reader (IR) in UK classrooms for eight- and nine-year-old pupils. This is the first evaluation of this intervention that uses a randomised control trial (RCT) design, following promising findings related to the use of IR from a…

Almost 20% of English pupils still experience difficulties with reading despite the use of a predominantly phonics-based approach that works well for most children, but not for all; therefore, other approaches need to be explored. The Integrated Group Reading (IGR) programme involves an inclusive approach to targeted teaching led by class teachers…

This report summarizes the results of a cluster-randomized field trial that estimated the effect of "BURST[R]: Reading" on primary grades students' early literacy achievement. BURST is a widely adopted supplemental reading program designed for use with students struggling to acquire early literacy skills and is meant to provide…

In this digital era, a fundamental challenge is to design digital reading materials in such a way that they improve children's reading skills. Since reading books is challenging for many fifth graders--particularly for those genetically susceptible to attention problems--the researchers hypothesized that guidance from a digital Pedagogical Agent…

Pathblazer is a supplemental, online intervention program that helps struggling learners in grades K-8 achieve grade-level proficiency in mathematics and reading. It offers students individualized learning progression paths with fun, motivating content that addresses skill and concept gaps. Using existing student data or results from a screener,…

This randomized controlled trial in 55 low-performing schools across Florida compared 2 early literacy interventions--1 using stand-alone materials and 1 using materials embedded in the existing core reading/language arts program. A total of 3,447 students who were below the 30th percentile in vocabulary and reading-related skills participated in…