Single case experimental designs are an important research design in behavioral and medical research. Although there are design standards prescribed by the What Works Clearinghouse for single case experimental designs, these standards do not include statistically derived power computations. Recently we derived the equations for computing power for…

This Study Snapshot highlights key findings from a study that examines up-to-date information about evidence-based practices that are essential for early childhood educators and policymakers as they support preschool children's language and literacy development. The study used a process modeled after the What Works Clearinghouse (WWC) methodology…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

Over the last twenty years, education researchers have increasingly conducted randomised experiments with the goal of informing the decisions of educators and policymakers. Such experiments have generally employed broad, consequential, standardised outcome measures in the hope that this would allow decisionmakers to compare effectiveness of…

Empirical growth benchmarks, as introduced by Hill, Bloom, Black, and Lipsey (2008), are a well-known way to contextualize effect sizes in education research. Past work on these benchmarks, both positive and negative, has largely avoided confronting the role of vertical scales, yet technical issues with vertical scales trouble the use of such…

Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability.…

There have been increasing calls for applied researchers to see and utilize effect sizes as the primary outcomes of their research. However, this sometimes places a methodological burden on researchers whose primary interests are substantive. Motivated by a desire to help applied researchers better report effect sizes and their confidence…

This paper contributes to the class size literature by analysing whether short-run class size effects are constant across grade levels in compulsory school. Results are based on administrative data on all pupils enrolled in Danish public schools. Identification is based on a government-imposed class size cap that creates exogenous variation in…

High school students have had some difficulties in understanding chemistry due to traditional ways of teaching this specific science. It is important to improve teaching methods that increase student motivation, not only to enhance their capacity for understanding, but also to generate a greater level of interest in the study of chemistry for…

Serious games have become increasingly available to educators. Empirical studies and meta-analyses have examined their impact on learning achievement. However, natural sciences could have a special relation to serious games by their systematic use of quantitative and predictive models that can generate microworlds and simulations. Since no known…

This policy brief summarizes the positive results of a rigorous evaluation of Reading Partners, a widely used program that offers one-on-one tutoring provided by community volunteers to struggling readers in low-income elementary schools. A total of 1,265 students in 19 schools in three states were randomly assigned to receive Reading…

The purpose of this article is to present various single-case outcome assessment methods for evaluating school-based intervention effectiveness. We present several outcome methods, including goal attainment scaling, visual analysis, trend analysis, percentage of non-overlapping data, single-case mean difference effect size, reliable change index,…

Methodologists have recently proposed robust variance estimation as one way to handle dependent effect sizes in meta-analysis. Software macros for robust variance estimation in meta-analysis are currently available for Stata (StataCorp LP, College Station, TX, USA) and SPSS (IBM, Armonk, NY, USA), yet there is little guidance for authors regarding…

School improvement programs that work in some places don't work in others. School improvement programs that work with some students don't work with others. Programs that appear to have positive effects in the hands of some teachers don't work for other teachers. If we can't be confident that a program will travel well, from one…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…