This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

Little research has explored the impact of teacher behavior in the relationship between classroom movement breaks and student outcomes. The authors' primary purpose was to explore teacher behavior during classroom movement breaks to determine if teacher behavior served as a moderating variable in the relationship between physical activity and…

A quasi-experimental study was conducted to examine the impact of Strategic and Interactive Writing Instruction on 3rd-5th grade deaf and hard of hearing students' writing and written language compared to a business-as-usual condition (treatment group N = 41, comparison group N = 22). A total of 18 hours of instruction was provided for each of two…

The purpose of this study was (i) to investigate if the compensatory effect of text-to-speech (TTS) technology on reading comprehension and reading rate in schoolchildren with reading disability is influenced by problems with inattention and hyperactivity and (ii) to examine whether a potentially moderating effect of such symptoms differ between…

Data-based decision making (DBDM) is an important element of educational policy in many countries, as it is assumed that student achievement will improve if teachers worked in a data-based way. However, studies that evaluate rigorously the effects of DBDM on student achievement are scarce. In this study, the effects of an intensive…

This study investigated the influence of strategy training instruction and an extrinsic incentive on American fourth- and fifth-grade students' (N = 35) performance, confidence in performance, and calibration accuracy. Using an experimental design, children were randomized to either an experimental group (strategy training and an extrinsic…

Although video cases and video clubs have become popular forms of teacher professional development, there have been few systematic investigations of designs for such programs. Programs may vary according to (a) whether teachers watch videos of their own/their peers' instruction, or whether teachers watch stock video of unknown teachers; and (b)…

This experimental study examined the effectiveness of a text-based reading and vocabulary intervention with self-regulatory supports for 4th graders with low reading comprehension. Students with standard scores on the Gates MacGinitie Reading Test between 1.0 standard deviation (SD) and 0.5 SD below the normative sample were included (N=44) and…

This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours)…

We present results of an experimental study of an urban, museum-based science teacher PD programme. A total of 125 teachers and 1676 of their students in grades 4-8 were tested at the beginning and end of the school year in which the PD programme took place. Teachers and students were assessed on subject content knowledge and attitudes towards…

Reading and comprehending content area texts require learners to effectively select and encode with hierarchically strategic memory structures in order to combine new information with prior knowledge. Unfortunately, evidence from state and national tests shows that children fail to successfully navigate the reading comprehension challenges they…

The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students…

The present study used a randomized control trial to examine the effects of a widely-used multi-component Tier 2 type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students…