This introduction to the major concepts of cost-benefit analysis (CBA) is intended for individuals involved in health care provider education who are attempting to measure the costs and benefits of their educational activities. After tracing the development of CBA, the paper defines it as an attempt to quantify and compare the expenditures for a…

This analysis reveals critical weaknesses surrounding the theoretical basis for the AIR (American Institutes for Research) evaluation design. It poses questions concerning the evaluation methodology. Specifically, it identifies major discrepancies in the identification of the target population, the selection of comparable control groups, test…

The effects of using different data analysis methods on estimates of treatment effects of educational programs were investigated. Various regression models, such as those recommended for Title I program evaluations, were studied. The first effect studied was the amount of bias that might be expected to occur in the various settings. Results…

Albuquerque's Title I evaluation staff is in the process of generating a comprehensive local evaluation design because it considers the federally required product evaluation unsatisfactory. The required mean-gain comparisons were extended beyond the dimension of program to the dimensions of school, grade, and Title I instructor. This evaluation…

In discussing the problems of evaluating Canadian bilingual immersion programs, six related aspects are separately considered: (1) the research design, (2) the students tested, (3) the nature of the tests used, (4) the methods of analysis employed, and (5) the interpretation of findings. (Author/SJL)

Distortion and selective disclosure limit data that are available to program evaluators, producing a bias that tends to maintain the status quo. Paradoxically, attempts to objectify the data only increase the potential for distortion. Ironically, one way to encourage innovation may be to not measure it. Additional solutions are suggested.…

Four projects aimed at evaluating the technical quality of recent summative evaluations are discussed, and models of metaevaluation are presented. Common technical problems are identified and practical methods for solving these problems are outlined, but these methods are limited by the current state of the art. (Author/CTM)

Evaluations of special education interventions are different from research on medical interventions. Educational evaluations would be more useful if they applied an actuarial, or probability approach. Information should be collected over time and using various measures, thus increasing the available data. (GDC)

Significant questions are raised concerning the Baker/de Kanter review, which concluded that "the case for the effectiveness of transitional bilingual education is so weak that exclusive reliance on this instructional method is clearly not justified." Sources used show methodological problems and multiple examples of deficiences in nine…

The promise of the stakeholder approach to evaluation lies in its potential to counter criticism that evaluation is too narrow, unrealistic in its standards for success, unfair to program staff and participants, and irrelevant to decision makers. (Author)

Critiquing the stakeholder idea, the author states: if government chooses to take account of competing views in social program evaluation, it can get a better result if it encourages the competing views to find a voice of their own, not to speak through the government's chosen instrument. (Author/PN)

Outlines the pros and cons of Project JOLT, a "Scared Straight" type of program. Raises some theoretical, methodological, and political issues surrounding the Scared Straight approach. Illustrates some of the pitfalls in program evaluation in corrections and makes some recommendations. (Author/RC)

A model is described which illustrates two general uses of multiple analyses to evaluate quasi-experiments: obtaining estimates of the treatment effect, and checking the validity of the experiment. (MH)

Reviews the process employed in evaluating the national 4-H program. Holds that the evaluation design was influenced by political, rather than methodological, concerns. Takes examples from the 4-H evaluation to illustrate dilemmas that have emerged in current evaluation process and theory. (Author/GC)