The article and commentary in this special section consider the ethical implications of a remark by an employee in a business being evaluated that employees have been advised to make the program look good. Explores the implications for the evaluation and its usefulness. (SLD)

Studied the nature of barriers to the implementation of external program evaluation through interviews with 18 staff members of a university outreach program. Findings reinforce the importance of a trusting relationship to avoid barriers to evaluation implementation. (SLD)

The most recent attempt by educators to emulate the "sound principles" and methods of business and science is to become data-driven. The leaders in a data-driven school are able to demonstrate how some number, preferably scores on standardized tests, has moved upward as a result of some program they have initiated. Data-driven schools also possess…

The nine articles of this theme issue provide overviews of legislative program evaluation and demonstrate the tensions caused by the conflict between utility and rigor in such evaluations. Legislative evaluation is concerned with evaluation utilization because legislators commission evaluations they expect to use. (SLD)

While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

This theme issue is an attempt to improve graphical production by evaluators. The graphs that are described are solutions to problems in communicating evaluation findings. Eleven chapters and a conclusion discuss common and recurring problems for graphs for discovery or presentation, and for evaluators or evaluation audiences. (SLD)

A survey was conducted to catalog the assessments used by 125 practitioners to evaluate the problem behaviors displayed by clients with mental retardation. Results indicate most practitioners rated functional assessment procedures as extremely or very useful. Findings are discussed with emphasis on the difficulties in conducting functional…

Chelimsky, former head of the Program Evaluation and Methodology Division of the General Accounting Office, suggested that advocacy by evaluators destroys their credibility. Evaluators should, this author argues, be advocates for democracy and the public interest, with the question being how explicitly and how defensibly. (SLD)

Critically examines five issues surrounding the use of student evaluations of teaching for summative decisions: current practices, validity concerns, improving the reporting of results, improving the decision-making process, and incorporating validity estimates into the decision-making process. Concludes with a list of recommendations for…

Responds to Abrami's proposals in "Improving Judgments about Teaching Effectiveness Using Teacher Rating Forms." Draws from comments made by members of an American Education Research Association special interest group and offers a personal perspective. (EV)

Preceding articles in this issue, "Improving Judgments about Teaching Effectiveness Using Teacher Rating Forms" (Abrami) and "Can We Put Precision into Practices? Commentary and Thoughts Engendered by Abrami's 'Improving Judgments about Teacher Effectiveness Using Teacher Rating Forms,'" offered: (1) Abrami's proposals to…

Strategies for use by clients who commission evaluation studies in the private, university, or governmental sector are outlined. Topics covered include establishing the purpose of the evaluation, assembling in-house management staff, specifying work and expertise requirements, establishing confidentiality and project control, and managing results.…

This new edition is the result of an extensive review of the standards as defined in 1981. Taken as a set, the 30 current standards provide a working philosophy for evaluation. They define the Joint Committee on Standards for Education Evaluation's conception of the principles that should guide and govern program evaluation efforts, and they offer…

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…