This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…

Recent studies show that texting-based interventions can produce educational benefits in children across a range of ages. We study the effects of a text-based program for kindergarten parents, distinguishing a general program from one that adds differentiation and personalization based on the child's developmental level. Children in the…

The Parent Academy was a series of classes for pupils' parents, designed to improve the English and mathematics attainment of pupils in Years 3 to 6 in English primary schools. Parents were offered the opportunity to participate in 12 Parent Academy classes, 6 on English and 6 on mathematics, delivered fortnightly by tutors with teaching…

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

This study evaluates the impact of the Retired Mentors for New Teachers program, a two-year mentoring program at the elementary school level developed by Aurora Public Schools in Colorado. Many of the district's schools serve a large percentage of economically disadvantaged children, experience high teacher turnover, and hire newer, less…

Policy-makers are frequently interested in understanding how effective a particular intervention may be for a specific (and often broad) population. In many fields, particularly education and social welfare, the ideal form of these evaluations is a large-scale randomized experiment. Recent research has highlighted that sites in these large-scale…

This Learner Response System (LRS) intervention involves the use of electronic handheld devices that allow teachers and pupils to provide immediate feedback during lessons. For example, pupils can respond to a question using the device and responses are immediately visible to the teacher, or they can work through problems on the device at their…

Mind the Gap sought to improve the metacognition and academic attainment of pupils in Year 4. There were two aspects to the intervention. The first involved training teachers in how to embed metacognitive approaches in their work, and how to continue to effectively and strategically involve parents. This training took place over a day and was…

The Hampshire Hundreds project was a local authority-led intervention which brought together lead teachers from Hampshire primary schools to provide them with evidence and support for effective teaching strategies to decrease the attainment gap between disadvantaged pupils (aged 9-11) and their peers. The intervention involved a facilitator…