Introduction: Missing data are bound to occur in education intervention research. Reasons vary but always have the consequence of reducing sample sizes and can, under certain conditions, seriously bias estimated intervention effects. A wide array of methods have been developed for handling missing data (Enders, 2023). Whereas older approaches…

Randomized experiments are a strong design for establishing impact evidence because the random assignment mechanism theoretically allows confidence in attributing group differences to the intervention. Growth of randomized experiments within educational studies has been widely documented. However, randomized experiments within education have…

Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. In rating the quality of causal research, the WWC has historically prioritized internal validity over external validity. One…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

Cluster randomized trials (CRTs) are commonly used to evaluate the causal effects of educational interventions, where the entire clusters (e.g., schools) are randomly assigned to treatment or control conditions. This study introduces statistical methods for designing and analyzing two-level (e.g., students nested within schools) and three-level…

Randomized controlled trials have proliferated in education, in part because they provide an unbiased estimator for the causal impact of interventions. It is increasingly recognized that many such trials in education have low power to detect an effect if indeed there is one. However, it is less well known that low powered trials tend to…

There are marked racial and ethnic disparities in diagnosis and services for individuals on the autism spectrum, yet race and ethnicity are underreported and underexamined in autism research. The current study examines the reporting of race and ethnicity and the inclusion of participants across racial and ethnic groups in studies included in a…

Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

In this commentary on John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," Tommy MacKay discusses three examples that illustrate Raven's tendency to overstate or at least to over-simplify the issues raised in his paper and to present various views, approaches, or interventions as being…

Missing data are ubiquitous in studies examining preventive interventions. This missing data need to be handled appropriately for data analyses to yield unbiased results. After a brief discussion of missing data mechanisms, inappropriate missing data treatments and appropriate missing data treatments, we review the current state of missing data…

Background: Interventions for offenders with intellectual disabilities (ID) have used cognitive variables as measures of treatment outcome. However, the relevance of cognitive variables to offending in people with intellectual disabilities is unclear. This review aimed to evaluate the evidence for a relationship between cognitive variables and…

John Raven has the capacity to see a bigger picture and highlight some of the causes of failures of that bigger picture. In barely 6000 words, he manages to outline several meta and micro-level problems that have led to the position he outlines regarding evidence-based interventions. This achievement should not be overlooked; what he has managed…

In this article John Raven responds to commentaries on his article, "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions" (EJ1248321). Herein, he provides dialogues with individual authors that relate closely to his original theme and which seemed to merit further elaboration. He briefly addresses: (1)…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly common in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly com- mon in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…