This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

Discusses methodological issues that emerged in evaluating a three-year paternal involvement demonstration project for poor inner-city noncustodial fathers. The dilemmas that arose from the contradictory goals of program evaluation and the need to meet federal and state waiver goals are discussed, and the tradeoffs needed to ensure a meaningful…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

The author's optimistic view of evaluation in the future includes increased utilization, especially in the private sector; more professionalization, with potential for conflict; more academic program development; more use in policy; increase in the use of complex methods; and more involvement in program development. (SLD)

Conjectures about the future use of controlled randomized experiments for planning and evaluating social programs suggest that they will frequently involve institutions and organizations rather than individuals and that their applications and the publicity surrounding them will increase as they are used in new and controversial ways. (SLD)

Seven chapters present 31 propositions challenging traditional ideas about the nature and practice of program evaluation. Methods to improve evaluation models and approaches and ways to address intermediate and advanced evaluation issues are explored. The discussion also serves as an introduction to the most analytical and comprehensive of the…

The Annual Performance Report submitted by each state to the Office of Vocational and Adult Education was used to monitor what states have developed and how and to what extent states have implemented their accountability system. The following findings of this analysis are synthesized in this report: (1) 32 states require evaluation of all programs…

In this article, two problems associated with the expectation that teachers use contemporary assessment techniques are examined. The first problem relates to teachers' sense-making of assessment data. Illustrative cases revealed that teachers' processes of interpretation of students' understanding, knowledge and learning of mathematics draws on a…

In 1989 the Department of Education contracted with Development Associates, Inc., to conduct a review of the evaluation and improvement practices of projects funded under Title VII of the Elementary and Secondary Education Act, often known as the Bilingual Education Act. The study focused on local transitional bilingual education and special…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…