This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

Access to Head Start has been shown to improve children's preschool experiences and school readiness on selected factors through the end of 1st grade. Two more years of follow-up, through the end of 3rd grade, can now be examined to determine whether these effects continue into the middle elementary grades. The statistical design and impact…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Care Quality Rating and Improvement Systems (QRISs) have advanced and matured, a number of states and localities have undertaken evaluations to validate the systems. Such efforts stem from the desire to ensure that the system is designed and operating in the ways envisioned when the system was established. Given that a central component in a QRIS…

The potential for music programs to promote psychosocial wellbeing in mainstream schools is recognised in both policy and research literature. Despite this recognition, there is a dearth of consistent research evidence supporting this link. Authors attribute this lack of consistent evidence to limitations in the areas of research design and…

This article describes the Voluntary Support for Education (VSE) Survey, an instrument created by the Council for Aid to Education. Our objective is to explain VSE's potential value as a tool to inform both institutional and academic research regarding fund-raising activities at community colleges. Of particular interest is how the data available…

When attempting to determine if an intervention has a causal impact, the "gold standard" of program evaluation is the randomized controlled trial (RCT). In education studies random assignment is rarely feasible at the student level, making RCTs harder to conduct. School-level assignment is more common but this often requires considerable resources…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

This article presents propensity score matching as a method to implement randomized conditions to analyze service effects using nonexperimental data. Most social work research is challenged to implement randomized clinical trials, whereas administrative and survey data are often available and can provide valuable information about services…

The notion of comparing in curriculum evaluation is discussed, and some approaches to making comparative judgments about program effectiveness during the formative and summative evaluation stages are examined. Sources of information provided by external and internal program comparisons are described, and a model in which a policy capturing…

A repeated measures design was used to assess the effects of a methadone maintenance program in several California locations. Subjects were 720 Chicano and Anglo men and women participating in rehabilitation programs for heroin addicts. The subjects were interviewed between 1978-1981, and the average follow-up time after initial treatment was 4-6…

Two studies used experimental data to evaluate nonexperimental methods of program evaluation for employment and training programs. Results of both studies indicated that the nonexperimental methods might not accurately replicate the experimental estimates. Also, new methods for constructing comparison groups yielded little improvement over…

Estimates of the Comprehensive Employment and Training Act's net impact on participant earnings, using Continuous Longitudinal Manpower Survey data, were compared to a similar sample from the Current Population Survey. The use of multivariate matching and weighting yielded acceptable results. (GDC)