There are a growing number of large-scale educational randomized controlled trials (RCTs). Considering their expense, it is important to reflect on the effectiveness of this approach. We assessed the magnitude and precision of effects found in those large-scale RCTs commissioned by the UK-based Education Endowment Foundation and the U.S.-based…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

More aggregate data on school performance is available than ever before, opening up new possibilities for applied researchers interested in assessing the effectiveness of school-level interventions quickly and at a relatively low cost by implementing comparative interrupted times series (CITS) designs. We examine the extent to which effect…

A recent paper uses Bayes factors to argue a large minority of rigorous, large-scale education RCTs are "uninformative." The definition of "uninformative" depends on the authors' hypothesis choices for calculating Bayes factors. These arguably overadjust for effect size inflation and involve a fixed prior distribution,…

Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

Increasing evidence indicates that individuals with Intellectual Disabilities (ID) might benefit from phonics-based reading instruction. However, research and instruction in this field has predominantly focused on sight word reading. Models for complex interventions recommend that feasibility research be conducted prior to conducting randomised…

This report presents findings from exploratory, descriptive meta-analyses of effect sizes reported by the first 82 EEF evaluations that used a randomised controlled trial (RCT) or clustered RCT impact evaluation design published up to January 2019. The review used a theoretical framework derived from literature with five overarching themes to…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

This document provides supplementary statistical tables to support the review of Education Endowment Foundation (EEF) evaluations. This includes: (1) Descriptive (univariate) tables for all explanatory variables; (2) Tables for the meta-analyses of primary ITT effect sizes; (3) Tables for the meta-analyses of secondary ITT effect sizes; (4) Tables…

Executive functions (EFs) develop rapidly in preschoolers and lay an important foundation for school readiness. One potential method of supporting EF development is through mindfulness-based interventions (MBIs). Whereas studies with older children and adults have supported this approach, research with young children has been more limited. In the…

Cluster randomized trials (CRTs), or studies in which intact groups of individuals are randomly assigned to a condition, are becoming more common in the evaluation of educational programs, policies, and practices. The website for the National Center for Education Evaluation and Regional Assistance (NCEE) reveals they have launched over 30…

This study evaluated the efficacy of the Preschool First Step (PFS) to Success early intervention for children at risk for attention deficit hyperactivity disorder (ADHD). PFS is a targeted intervention for children 3-5 years old with externalizing behavior problems and addresses secondary prevention goals and objectives. As part of a larger…

This paper describes a randomised controlled trial conducted with 10 secondary schools in England to evaluate the impact and feasibility of Fresh Start as an intervention to help new entrants with low prior literacy. Fresh Start is a synthetic phonics programme for small groups of pupils, here implemented three times per week over 22 weeks. The…

Rhythm for Reading is a programme which aims to improve children's reading ability by taking part in rhythm-based exercises such as stamping, clapping and chanting, while reading musical notation. The intervention builds on the evidence of a link between the natural rhythm and phrasing of prose and intuitive reading comprehension. Rhythm for…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…