Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

A growing body of correlational research finds a relationship between self-efficacy--beliefs in one's capabilities--and academic success. But few studies have investigated whether self-efficacy is causally related to academic success. We hypothesized that an experience of success would promote self-efficacy in junior high school students and would…

We develop a theoretical and empirical basis for the design of teacher professional development studies. We build on previous work by (a) developing estimates of intraclass correlation coefficients for teacher outcomes using two- and three-level data structures, (b) developing estimates of the variance explained by covariates, and (c) modifying…

Cluster randomized experiments are now widely used to examine intervention effects in prevention science. It is meaningful to use empirical benchmarks for interpreting effect size in prevention science. The effect size (i.e., the standardized mean difference, calculated by the difference of the means between the treatment and control groups,…

Background: There is an increased focus on randomized trials for proximal behavioral outcomes in early childhood research. However, planning sample sizes for such designs requires extant information on the size of effect, variance decomposition, and effectiveness of covariates. Objectives: The purpose of this article is to employ a recent large…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

It has been claimed that physical activity has a positive effect on not only health but also on school performance. Using data from a randomised school-intervention study, this paper investigates whether different interventions promoting physical activity affect school performance in primary school children. The results indicate that on average,…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

In unequal societies the effectiveness of formal education depends on the socioeconomic status (SES) of students. Studies have shown that poverty affects the development of the brain in ways that might compromise future learning, thus increasing the differences between groups with different SES. Interest is growing in the development of tools that…

This study examined the effectiveness of two instructional mind-mapping approaches to stimulate fifth and sixth graders' graphical summarization skills. Thirty-five fifth- and sixth-grade teachers and 644 students from 17 different elementary schools participated. A randomized quasi-experimental repeated-measures design was set up with two…

A cluster-randomized trial (CRT) relies on random assignment of intact clusters to treatment conditions, such as classrooms or schools (Raudenbush & Bryk, 2002). One specific type of CRT, a multi-site CRT (MSCRT), is commonly employed in educational research and evaluation studies (Spybrook & Raudenbush, 2009; Spybrook, 2014; Bloom,…

The current study examines classroom-level peer behavioral regulation skills and their implications for children's school readiness outcomes. Specifically, this study will answer the following research questions: (1) Is the average level of peers' behavioral regulation skills in a classroom in the fall associated with growth in children's school…

As part of the 2010 economic stimulus, a $55 million "Investing in Innovation" (i3) grant from the US Department of Education was awarded to scale up Reading Recovery across the nation. This paper presents the final round of results from the large-scale, mixed methods randomized evaluation of the implementation and impacts of Reading…

The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students…