Background: The data revolution in education has led to more data collection, more randomized controlled trials (RCTs), and more data collection within RCTs. Often following IES recommendations, researchers studying program effectiveness gather data on how the intervention was implemented. Educational implementation data can be complex, including…

Several studies suggest that values-affirmation can serve as a simple, yet powerful, tool for dramatically reducing achievement gaps. Because subtle variations in implementation procedures may explain some of the variation in these findings, it is crucial for researchers to measure the fidelity with which interventions are implemented. The authors…

This paper examines the "ecological validity" of a randomized controlled trial (RCT) conducted in 42 high schools to measure the impact of a content literacy program. This study of comparable schools implementing the same program in different contexts highlights characteristics that are often not attended to in rigorous effectiveness…

In this presentation discussed in this brief abstracted report, the author presents about an ongoing partnership with the Philadelphia School District (PSD) to implement and research the Ongoing Assessment Project (OGAP). OGAP is a systematic, intentional and iterative formative assessment system grounded in the research on how students learn…

Recognizing that standardized instructional treatments may not be equally effective across contexts, a growing number of scholars are arguing that the strategy of adopting packaged programs and striving to implement them faithfully is neither realistic nor desirable. An alternative view is that scaling up educational treatments requires balancing…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

The Fidelity of Implementation (FOI) study that is the focus of this report was conducted as a component of a scale-up effectiveness trial of the SRA/McGraw-Hill Open Court Reading program. The overall purpose of the FOI study was to support and provide context for findings from the larger experimental impact study of Open Court Reading (OCR). To…

If children do not learn how to read in the first few years of primary school, they will struggle to complete the cycle and are at greater risk of dropping out. It is therefore crucial to identify and test interventions that have the potential of making a large impact, can be implemented quickly, and are affordable to be taken to scale by the…

Nationally, two-thirds of high school students are unable to read and comprehend complex academic materials, think critically about texts, and synthesize information from multiple sources, or communicate what they have learned. Without a substantial change in their academic literacy, U.S. high school students face continued academic problems in…

Research in social and emotional learning interventions confirms the importance of fidelity of implementation in predicting intervention effectiveness (Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011). The present mixed-methods study was conducted in the context of the Responsive Classroom Efficacy Study (RCES). This was a randomized…

The low level of mathematics performance of U.S. students in relation to national standards and in international comparisons has concerned educators and policy makers for many years. The authors' primary goals were to design a feasible and usable intervention and gather data on the promise of the intervention to foster students' conceptual…

This paper considers one challenge from recent emphasis on rigorous research for decision-making in education: the interpretation of non-replicated findings. Under Clinton and Bush, the federal government called for and funded highly rigorous research. The "gold-standard" for research was randomized-control trials (RCTs), which…

Writing is an essential skill for participating in modern American society. Although it is crucial to careers and civic engagement, student writing falls far short of national expectations (College Board, 2004; NCES, 2012; Persky, Daane, & Jin, 2003). The Common Core State Standards (CCSS) seek to increase the rigor of writing instruction…

In experimental studies, researchers are often interested in secondary research questions that explore important aspects of main findings, such as whether or not program effects vary according to the level of fidelity in which the program has been implemented; or according to the dosage received by individuals participated in the program. In this…

The Good Behavior Game (GBG) is a classroom-based behavior management strategy aimed at reducing aggressive/disruptive behavior and socializing children into the role of student. GBG, delivered in first and second grades, has been shown to reduce rates of substance abuse and other deleterious outcomes into young adulthood (Brown, C.H. et al 2007,…