Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

This paper describes the context, processes and issues experienced over 5 years in which a RCT was carried out to evaluate a programme for children aged 7-8 who were struggling with their reading. Its specific aim is to illuminate questions about the design of complex teaching approaches and their evaluation using an RCT. This covers the early…

To plan cluster-randomized trials with sufficient statistical power to detect intervention effects on student achievement, researchers need multilevel design parameters, including measures of between-classroom and between-school differences and the amounts of variance explained by covariates at the student, classroom, and school level. Previous…

With the increasing demand for evidence-based research on teacher effectiveness and improving student achievement, more impact studies are being conducted to examine the effectiveness of professional development (PD) interventions. Cluster randomized trials (CRTs) are often carried out to assess PD interventions that aim to improve both teacher…

Background: The Scandinavian countries have a long history of implementing social interventions, but the interventions have not been examined using randomised controlled trials until relatively recently compared with countries like the United States and the United Kingdom. Purpose: The purpose of this paper is to examine the history of randomised…

This systematic review will focus on curriculum based social and emotional learning (SEL) interventions delivered in preschool or primary/elementary schools aimed at improving social and emotional skills among pupils. It will include any universal programme, delivered on a whole-class or school basis. The interventions' primary goal must be to…

Demands for scientific knowledge of what works in educational policy and practice has driven interest in quantitative investigations of educational outcomes, and randomized controlled trials (RCTs) have proliferated under these conditions. In educational settings, even when individuals are randomized, both experimental and control students are…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

Research has shown that teacher effectiveness is the most important school-based factor that influences student outcomes, including student achievement. Studies have also shown that there is substantial variation in teacher effectiveness, such that some teachers improve student outcomes at a much faster rate than others. The strong influence of…

Randomised controlled trials (RCTs) are increasingly used to evaluate educational interventions in the UK. However, RCTs remain controversial for some elements of the research community. This paper argues that the widespread use of the term "gold standard" to describe RCTs is problematic, as it implies that other research methods are…

Accelerated Reader™ is a computerized supplementary reading program that provides guided reading instruction to students in grades K-12. It aims to improve students' reading skills through reading practice and by providing frequent feedback on students' progress to teachers. The Accelerated Reader™ program requires students to select and read a…

Interest in variation in program impacts--How big is it? What might explain it?--has inspired recent work on the analysis of data from multi-site experiments. One critical aspect of this problem involves the use of random or fixed effect estimates to visualize the distribution of impact estimates across a sample of sites. Unfortunately, unless the…