A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

Statistical approaches to assess how prevention and intervention programs achieve their effects are described and illustrated through the evaluation of a health promotion program to reduce dietary cholesterol and a school-based drug prevention program. Analyses require the measurement of intervening or mediating variables to represent the…

This paper evaluates the effectiveness of self-deferral, a social screen implemented to protect the U.S. blood supply from human immunodeficiency virus (HIV) infection prior to the advent of laboratory testing. Mathematical models are developed to estimate the number of infectious transfusions ultimately leading to AIDS prior to self-deferral.…

A methodology for calculating the return on training investment is described. The method covers attitudes, knowledge, and behavior of participants as well as effectiveness in organizational improvement. Output, time savings, quality improvements, and "soft data" on effectiveness are set against costs. (TJH)

Statistical methods for program evaluation with nonexperimental data are reviewed with emphasis on circumstances in which nonexperimental data are valid. Three solutions are proposed for problems of selection bias, and implications for evaluation design and data collection and analysis are discussed. (SLD)

The application of time series analysis is described, focusing on the use of regression analysis for analyzing time series in a way that may make it more readily available to an evaluation practice audience. Practical guidelines are suggested for decision makers in government, health, and social welfare agencies. (SLD)

Modeling and data collection efforts needed to develop a test of the effectiveness of adult literacy and language training programs in increasing the earnings of trainees are reviewed. After reviewing the framework developed for the Manpower Development and Training Act and the Comprehensive Employment and Training Act (CETA) evaluations and the…