Background: Rooted in problems of social justice, intersectionality addresses intragroup differences in impacts and outcomes and the compound discrimination at specific intersections of classification (Crenshaw,1991). It stresses that deficits/debts in outcomes often occur non-additively; for example, discriminatory hiring practices can be…

Background: When RCTs are not feasible and time series data are available, panel data methods can be used to estimate treatment effects on outcomes, by exploiting variation in policies and conditions over time and across locations. A complication with these methods, however, is that treatment timing often varies across the sample, for example, due…

Experimental and quasi-experimental designs play a central role in estimating cause-effect relationships in education, psychology, and many other fields of the social and behavioral sciences. This paper presents and discusses the causal graphs of experimental and quasi-experimental designs. For quasi-experimental designs the authors demonstrate…

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

Randomized experiments are commonly used to evaluate the effectiveness of educational interventions. The goal of the present investigation is to develop small-sample corrections for multiple contrast hypothesis tests (i.e., F-tests) such as the omnibus test of meta-regression fit or a test for equality of three or more levels of a categorical…

Relatively few rigorous studies of the effectiveness of contemporary public prekindergarten programs have been conducted despite the growing number of programs and large monetary investments that accompany them. The study on which this presentation is based was launched in partnership with the Tennessee State Department of Education's Division of…

Recent federal legislation, such as the "No Child Left Behind Act" of 2001 and the "Education Sciences Reform Act (ESRA)" of 2002, has insisted that educational evaluations use rigorous research designs with quantitative outcome measures. In particular, the Institute of Education Sciences (IES) at the U.S. Department of…

Recognizing that standardized instructional treatments may not be equally effective across contexts, a growing number of scholars are arguing that the strategy of adopting packaged programs and striving to implement them faithfully is neither realistic nor desirable. An alternative view is that scaling up educational treatments requires balancing…

Interest in scaling up prekindergarten programs for children from low income families is dramatically increasing, especially with the announcement by President Obama of support for "universal preschool." Research in early education supports the idea of developmentally appropriate practice as reflected in instructional groupings and…

Policy-makers are frequently interested in understanding how effective a particular intervention may be for a specific (and often broad) population. In many fields, particularly education and social welfare, the ideal form of these evaluations is a large-scale randomized experiment. Recent research has highlighted that sites in these large-scale…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

The Common Core State Standards (CCSS) have been developed in response to the criticism that students in the U.S. are graduating from high school without being college and career ready and that they are falling behind their counterparts in other countries in key subject areas. In this work, the authors report the results of an efficacy study that…

Randomized controlled trials (RCTs) and regression discontinuity (RD) studies both provide estimates of causal effects. A major difference between the two is that RD only estimates local average treatment effects (LATE) near the cutoff point of the forcing variable. This has been cited as a drawback to RD designs (Cook & Wong, 2008).…

Although research on the effectiveness of differentiated and enriched instruction in improving the achievement of diverse students is still emerging, some studies suggest that students in academically diverse classrooms benefited academically from differentiated learning experiences. The primary research question explored in this study was…

In Belize, the percentage of untrained teachers (i.e. teachers with the equivalent of a high school education or less) is one of the highest in the region of Latin America and the Caribbean. In response to growing student cohorts, the increased demand for more classroom teachers has led to significant decrease in the proportion of trained teachers…