Meta-analyses are systematic summaries of research that use quantitative methods to find the mean effect size (standardized mean difference) for interventions. Critics of meta-analysis point out that such analyses can conflate the results of low- and high-quality studies, make improper comparisons and result in statistical noise. All these…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

More aggregate data on school performance is available than ever before, opening up new possibilities for applied researchers interested in assessing the effectiveness of school-level interventions quickly and at a relatively low cost by implementing comparative interrupted times series (CITS) designs. We examine the extent to which effect…

Recommendations for the prevention of childhood obesity encourage providers to counsel parents and their children on healthy diet and activity behaviors. This study evaluated the feasibility of a theory-based, tailored communication intervention for obesity prevention ("Team Up for Health") delivered during a well-child visit. A…

African-American women report higher levels of chronic conditions and church attendance relative to the overall US population. Therefore, efforts have increased over the past decade to design church-based health promotion programs. The present study compared changes in religiosity, religious social support and general social support across time…

The goal of this study is to better understand how methods for estimating treatment effects of latent groups operate. In particular, the authors identify where violations of assumptions can lead to biased estimates, and explore how covariates can be critical in the estimation process. For each set of approaches, the authors first review the…

Beginning in 2002, researchers developed, implemented, and evaluated the efficacy of an English reading intervention for first-grade English learners using multiple randomized control trials (RCTs). As a result of this efficacy work, researchers successfully competed for an IES Goal 4 effectiveness study using the same intervention. Unlike the…

Background: This study investigated the long-term effectiveness of Preventure, a selective personality-targeted prevention program, in reducing the uptake of alcohol, harmful use of alcohol, and alcohol-related harms over a 3-year period. Methods: A cluster randomized controlled trial was conducted to assess the effectiveness of Preventure.…

Background: We tested the effectiveness of the Go Wild With Fruits and Veggies! (GWWFV) Extension curriculum on increasing fruit and vegetable (FV) intake of third graders. Methods: An intervention study was used testing self-reported FV intake pre/post GWWFV. Recruited schools were randomized to control (12 schools, N = 369, third grade children)…

This article presents the results of a randomized clinical trial evaluating the eight-session "Family Eats" web-based intervention promoting healthy home food environments for African American families. African American families (n = 126) with 8- to 12-year-old children completed online baseline questionnaires and were randomized into…

Butterfly Phonics aims to improve the reading of struggling pupils through phonics instruction and a formal teaching style where pupils sit at desks in rows facing the teacher. It is based on a course book created by Irina Tyk, and was delivered in this evaluation by Real Action, a charity based in London. Real Action staff recruited and trained…

This study evaluates the impact of the Retired Mentors for New Teachers program, a two-year mentoring program at the elementary school level developed by Aurora Public Schools in Colorado. Many of the district's schools serve a large percentage of economically disadvantaged children, experience high teacher turnover, and hire newer, less…