Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

This article illustrates the synergistic role between practice and theory in evaluation. Using reflective practice, the author reviews her own work as well as the work of other evaluators to illustrate how theory can influence practice and, in turn, how evaluation practice can inform and grow theory, especially evaluation theory. The following…

The nine articles of this theme issue provide overviews of legislative program evaluation and demonstrate the tensions caused by the conflict between utility and rigor in such evaluations. Legislative evaluation is concerned with evaluation utilization because legislators commission evaluations they expect to use. (SLD)

Twelve specific suggestions for evaluators concerning development, presentation, and followup of improved evaluation recommendations are discussed. Offering effective recommendations requires special skills that need to be recognized, studied carefully, and passed along to practitioners and students. (TJH)

This article shows how microcomputer software can help in overcoming key methological problems in program/policy evaluation by: (1) paired comparisons; (2) sensitivity analysis to deal with missing information; (3) allocation percentages to deal with multiple alternatives; (4) sub-optimizing to deal with conflicting constraints; and (5) decision…

The value and limitations of conceptualizing evaluation as a decision-oriented research and appraisal activity is discussed. The decisional contexts of evaluation projects is examined in terms of a comparison between two models of organization decision making. Certain remedies for problems arising from attempts to enhance decisional relevance of…

Explores implications for evaluation practice of using five different perspectives on organizations, drawing on the four models of social program implementation developed by R. F. Elmore (1978). It is argued that evaluation will only really be effective when its focus, methods, and management reflect realistic assumptions about how organizations…

This sourcebook presents information about three types of federal decision makers who are frequent clients of evaluation: career government executives; political appointees; and congressional staff members. Differences among these decision makers are highlighted in seven articles, with emphasis on meeting client needs and process dimensions of…

The Senate confirmation hearings concerning Robert Gates as director of the Central Intelligence Agency (CIA) highlight the problems evaluators share with the CIA of keeping policy imperatives out of the search for truth. The CIA at least has a structure for keeping information pure, but many evaluations do not. (SLD)

Program design can aid problem-solving or decision-making tasks faced by evaluators. It can be used to facilitate evaluation planning through the definition of program boundaries and the generation and focusing of evaluation questions. Further, it can provide evaluation information about theoretical, historical, and political contexts of a…

Dilemmas emerged in the evaluation of a school improvement project that required evaluators to confront merging varied and often conflicting perspectives, sources of data, understandings of their roles as evaluators, the eventual use of the data, and the purpose of the educational reform effort. Selected examples are presented from the evaluation…

The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

A taxonomy of potential values conflicts in evaluations is presented. Basis is the distinction of types of conflict (aims vs. means conflicts; qualitative vs. quantitative conflicts). Six areas of values are discussed: the ethical, methodical, social and interactive, legal, economic, and personal values. The taxonomy of conflicts between these…