Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

Some questions about the relationship between program evaluation and forecasting are raised. Contrasting the two fields in terms of mind-set, purpose, problems, advantages, and use shows that although their modes of inquiry are indeed very different in many ways, there is interdependence between the two in several areas. (Author/JAZ)

One source of bias, regression artifacts, in program evaluations that use regression discontinuity design is identified, and its importance is discussed. A method is suggested for its correction. Although use of this method does not solve the problem of selection bias, it does improve the reliability of nonexperimental methods. (SLD)

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

A broad set of ethical principles is examined to determine their relevance for evaluation. The five principles of K. S. Kitchener (autonomy, nonmaleficience, beneficence, justice, and fidelity) are relevant to evaluation and are fully represented in the evaluation standards of the Joint Committee on Standards for Educational Evaluation. (SLD)

The role of evaluation in electric utility demand-side management (DSM) programs is explored, including the importance of evaluation in determining financial incentives that a company will earn for DSM programs. A hypothetical example is presented of the types of problems that might arise when evaluations are subject to litigation. (SLD)

Six potential problems with the use of randomized experiments to evaluate programs in the field are addressed. Problems include treatment dilution, treatment contamination or confounding, inaccurate case flow and power estimates, violations of the random assignment processes, changes in the environmental context, and changes in the treatment…

The use of qualitative evaluation methods is explored as a means of overcoming constraints and complexities of evaluation of development programs. A case study demonstrating the application of qualitative analysis to monitoring and evaluation of the Basic Minimum Needs program in Thailand is presented. (SLD)

A sample of 459 American Evaluation Association members was surveyed about ethical challenges they encountered in evaluation work. Respondents report a wide variety of ethical conflicts, with evaluators frequently pressured to compromise their roles as scientists and the evaluation product. A framework is proposed for interpreting these findings.…

To explore the treatment fidelity of employee safety-belt programs, 614 organizations were divided into 2 groups: those that had (n=183), and those that had not (n=431) conducted an evaluation. Multiple regression analysis of associated data indicated that evaluation-active organizations were generally more active in other program areas. (TJH)

Estimates are presented for net earnings impact of the Comprehensive Employment and Training Act programs. Net impact was linked to the human capital model and estimated for numerous subgroups. The matching procedure and the use of quasiexperimental versus experimental design are also discussed. (Author/GDC)

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

Evaluation findings of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) Community Demonstration Program show few clear indications of the effectiveness of case management approaches. This article identifies phenomena that explain the lack of positive effects and suggests that evaluation problems may explain apparent negative…

Statistical identification of employees with unusual sick leave patterns can result in false-positive identifications. A computer simulation model was used to evaluate alternate methods of unusual sick leave detection for the New York State Department of Health. Results were used to refine identification parameters and modify supervisory…

The experience of development assistance (donor) agencies with the monitoring and evaluation of their projects in the developing countries is reviewed. The concepts and definitions of monitoring and evaluation are traced and problems and issues that emerged in the 1970's are reviewed. Future directions are discussed. (SLD)