Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

This paper examines the "ecological validity" of a randomized controlled trial (RCT) conducted in 42 high schools to measure the impact of a content literacy program. This study of comparable schools implementing the same program in different contexts highlights characteristics that are often not attended to in rigorous effectiveness…

The purpose of this study is to study the performance of different methods (inverse probability weighting and estimation of informative bounds) to control for differential attrition by comparing the results of different methods using two datasets: an original dataset from Portland Public Schools (PPS) subject to high rates of differential…

The Fidelity of Implementation (FOI) study that is the focus of this report was conducted as a component of a scale-up effectiveness trial of the SRA/McGraw-Hill Open Court Reading program. The overall purpose of the FOI study was to support and provide context for findings from the larger experimental impact study of Open Court Reading (OCR). To…

Randomized controlled trials (RCTs) are considered the "gold standard" for evaluating an intervention's effectiveness. Recently, the federal government has placed increased emphasis on the use of opportunistic experiments. A key criterion for conducting opportunistic experiments, however, is that there is relatively easy access to data…

This paper is the first summary of two studies and 10 years of evaluating the Milwaukee Parental Choice (voucher) Program (MPCP). This paper discusses school voucher evaluations in general terms and how these studies are carried out. The paper outlines the types of studies completed in "Study I" and "Study II" and the results…

This study addresses the effectiveness of a widely used core reading program that reflects the research-based practices recommended by the National Reading Panel. This and other similar programs are increasingly used to prevent reading difficulties and ensure that all children are reading at or above grade level by the end of third grade.…

Nationally, two-thirds of high school students are unable to read and comprehend complex academic materials, think critically about texts, and synthesize information from multiple sources, or communicate what they have learned. Without a substantial change in their academic literacy, U.S. high school students face continued academic problems in…

Randomized controlled trials (RCTs) and regression discontinuity (RD) studies both provide estimates of causal effects. A major difference between the two is that RD only estimates local average treatment effects (LATE) near the cutoff point of the forcing variable. This has been cited as a drawback to RD designs (Cook & Wong, 2008).…

The tutoring component of the Investing in Innovations (i3) funded Milwaukee Community Literacy Project (MCLP) is based on the Reading Recovery program. Reading Recovery focuses on in-school tutoring with lesson plans written, and assessments analyzed, by the tutors themselves. The objective of this study is to measure the impact of the MCLP on…

The Instructional Conversation (IC) is a complete classroom pedagogy that focuses on teaching through small-group dialogue with students allowing responsive instruction for each student. The IC is anchored by cognitive-developmental theory and by four decades of multi-method quasi-experimental studies. This study describes the first research of an…

This paper uses the credits-attempted perspective--in the context of how many credits a student attempts in their first year of college--and reports on several related projects all intended to evaluate potential interventions to raise academic momentum among first-year community college students. The presentation contrasts non-experimental…

Many researchers, policymakers, and university administrators have called for more students to major in Science, Technology, Engineering and Mathematics (STEM) fields to address the critical need for a diverse and technically skilled workforce that is prepared to address national problems and educate its future STEM leaders. One of the questions…

As a result of the 1998 reauthorization of Head Start, the Department of Health and Human Services conducted a national evaluation of the Head Start program. The goal of Head Start is to improve the school readiness skills of low-income children in the United States. There is a substantial body of experimental and correlational research that has…

This study seeks to answer the following question: Are impacts on Head Start classroom quality associated with impacts of Head Start on children's learning and development? This study employs a variety of descriptive and quasi-experimental methods to explore the role of classroom quality as a mediator or mechanism of Head Start impacts. This…