We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

In recent years, schools have started implementing preventive practices such as universal screening. Yet, researchers have not evaluated the extent to which universal screening contributes to academic and behavioral outcomes. The purpose of this study was to evaluate the treatment utility of universal screening for behavioral risk. Student…

This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

Item response time data were used in investigating the differences in student test-taking behavior between two device conditions: computer and tablet. Analyses were conducted to address the questions of whether or not the device condition had a differential impact on rapid guessing and solution behaviors (with response time effort used as an…

This multiyear scale-up effectiveness study of Open Court Reading (OCR) involved approximately 4,500 students and more than 1,000 teachers per year in Grades K-5 from 49 elementary schools in seven districts across the country. Using a school-level cluster randomized trial design, we assessed the implementation and effectiveness of Open Court…

The study aimed at investigating the effect of instruction through telegram groups on the learners' reading comprehension. Moreover, it investigated that whether there is any difference between two genders of the experimental groups in reading comprehension ability. For this purpose, 147 subjects were selected. To homogenize them, a standard…

In this study we investigated an editing strategy to develop effective proofreading skills (i.e., mechanics and substantive revisions) within electronic texts through an experimental pre- and posttest group design with random assignment. Fifteen college students with intellectual and developmental disabilities participated in this investigation.…

This experimental study examined the effectiveness of a text-based reading and vocabulary intervention with self-regulatory supports for 4th graders with low reading comprehension. Students with standard scores on the Gates MacGinitie Reading Test between 1.0 standard deviation (SD) and 0.5 SD below the normative sample were included (N=44) and…

This study examines the effectiveness of minimally trained tutors providing a highly structured tutoring intervention for struggling readers. We screened students in Grades K-6 for participation in an after-school tutoring program. We randomly assigned those students not meeting the benchmark on a reading screening measure to either a tutoring…

To improve the reading comprehension outcomes of children in high-poverty schools, policymakers need to identify reading interventions that show promise of effectiveness at scale. This study evaluated the effectiveness of a low-cost and large-scale summer reading intervention that provided comprehension lessons at the end of the school year and…

Reading comprehension in the content areas is a challenge for many middle grade students. Text structure-based instruction has yielded positive outcomes in reading comprehension at all grade levels in small and large studies. The text structure strategy delivered via the web, called Intelligent Tutoring System for the Text Structure Strategy…

This article reports on 2 experiments in inner-city Baltimore evaluating a computer-assisted tutoring approach, Tutoring With Alphie (TWA), in which 1 paraprofessional can work with up to 6 children at a time. In Study 1, we randomly assigned 14 schools to receive TWA or to continue with whatever approaches they were currently using. Each…

Reading and comprehending content area texts require learners to effectively select and encode with hierarchically strategic memory structures in order to combine new information with prior knowledge. Unfortunately, evidence from state and national tests shows that children fail to successfully navigate the reading comprehension challenges they…

This study examines the effectiveness of minimally trained tutors providing a highly structured tutoring intervention for struggling readers. We screened students in Grades K-6 for participation in an after-school tutoring program. We randomly assigned those students not meeting the benchmark on a reading screening measure to either a tutoring…