We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

Policy-makers are frequently interested in understanding how effective a particular intervention may be for a specific (and often broad) population. In many fields, particularly education and social welfare, the ideal form of these evaluations is a large-scale randomized experiment. Recent research has highlighted that sites in these large-scale…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

The nested data structure inherent in education (i.e. students nested in schools nested in districts) makes intact school matching an appealing approach in observational studies of educational interventions and policies for both theoretical and practical purposes. This paper provides guidance to applied education researchers who are employing…

We report on the scaling up of a high school content literacy framework, Reading Apprenticeship, over a period of four years as part of the independent evaluation of an Investing in Innovation grant from the U.S. Department of Education to WestEd's Strategic Literacy Institute (SLI). Our goal was to understand the school processes that support…

Preschool children with Autism Spectrum Disorder (ASD) may not always be recognized as such during their early years, but some of their behavioral problems may nonetheless prompt a referral for behavioral intervention. Whether such an intervention brings any benefit has not been well studied. We identified a subsample of 34 preschool children at…

Preschool children with Autism Spectrum Disorder (ASD) may not always be recognized as such during their early years, but some of their behavioral problems may nonetheless prompt a referral for behavioral intervention. Whether such an intervention brings any benefit has not been well studied. We identified a subsample of 34 preschool children at…

The field of early intervention is currently faced with the challenge of reducing the prevalence of antisocial behavior in children. Longitudinal outcomes research indicates that increased antisocial behavior and impairments in social competence skills during the preschool years often serve as harbingers of future adjustment problems in a number…

Recent work that has examined the impact of what are variously called periodic, interim, benchmark, or diagnostic assessments, typically administered three or four times during a school year, has produced mixed findings. For instance, one study reported small significant effects in mathematics in grades 3-8, but not in reading (Carlson et al.,…