Presents a three-part evaluation schema that provides the framework for describing a methodology that facilitates the evaluation process. Provides details on how to develop and use trainee reaction forms and opinionnaires. Includes sample forms and questionnaires. (Author/JOW)

This monograph identifies, analyzes, and judges 22 evaluation approaches used in program evaluation. Two approaches, labeled psuedoevaluations, are politically oriented and often used to misrepresent a program's value. The remaining 20, judged legitimate, are categorized by their orientations, and rated for their value. (SLD)

Discusses the use of Planned Variation evaluations, evaluations that implement and compare two or more promising variations of an educational or social program. Suggests several advantages for the Planned Variation approach and describes the Planned Variation Cross Validation Model. (SLD)

Outlines essential features of program theory evaluation and discusses how it has been used to address concerns about inadequacies of performance information systems. Suggests enhancing the usefulness of program evaluation theory by incorporating information about program contexts, defining success criteria and comparisons for judging and…

Suggests that research, development, and evaluation of social and educational programs should routinely be integrated through a planned variation approach that involves the design, implementation, and evaluation of an enhanced, as well as the standard, variation of a program. Compares the planned variation approach to other types of theory-based…

Methods suggested by research for evaluating training were compared to survey responses from 202 Canadian organizations regarding actual evaluation practices. Most organizations appeared to evaluate at only one or two of Kirkpatrick's four levels. However, this may be appropriate in light of program objectives, type of organization, and purposes…

Describes key aspects of an integrative framework that may help evaluators move beyond paradigm wars and the segmentation of evaluation practices. Proposes a scheme for categorizing evaluation methods with four inquiry modes, or clusters of methods: description, classification, causal analysis, and values inquiry. (Author/SLD)

Illustrates the difficulties of managing conflicts among formal standards in codes of ethics and among professional and personal standards through two examples from evaluation practice. The mediation of human judgment reveals an inevitable subjectivity that threatens the credibility of the field. (Author/SLD)

Opposes the practice of aggregating impacts on outcome dimensions to arrive at one summary assessment of program merit. Suggests that impacts should be kept separate and unweighted, expressed in their own measurement scales. Illustrates this method through an evaluation of the effects of research grants on a university. (SLD)

Shows how to bridge the gap between collaborative evaluations with extensive stakeholder participation and noncollaborative evaluations in which stakeholders do not participate to a great degree. Synthesizes research that shows that interaction with stakeholders helps enhance validity in noncollaborative evaluations. (SLD)

Describes key issues to consider in evaluating community capacity based on four community-based health programs that have included increasing community capacity or a related concept as one of the defined outcomes of their program and their subsequent evaluations. Two programs were rural, and the others, urban. (SLD)

Studied the perspectives of 15 individuals in 3 different stakeholder groups in the context of training evaluation: training sponsors, training providers, and training participants. Discusses the differing perspectives in terms of a three-dimensional schema of collaborative inquiry and evaluation and discusses implications for training and program…

Can this evaluation be saved? More precisely, can this evaluation be saved in such a way that both evaluator and client feel satisfied that their points of view were respected and both agree that the evaluation itself provides valid information obtained in a principled manner? Because the scenario describes a preliminary discussion and no contract…

The authors discuss the use of multiple evaluation approaches in conducting program evaluations. Specifically, they illustrate four evaluation approaches (theory-driven, consumer-based, empowerment, and inclusive evaluation) and briefly discuss a fifth (use-focused evaluation) as a side effect of the use of the others. The authors also address the…

Describes the oral history project and the team that worked on this oral history of program evaluation. Presents an interview with William R. Shadish, a program evaluation theorist and practitioner. (SLD)