Describes how Winnipeg public schools use an educational indicator system, including computer mapping graphics, to present indicator data to educational policymakers. Discusses issues and problems in the development and use of educational indicator systems, focusing on the relative importance of educational inputs, processes, and outcomes. (SV)

The Senate confirmation hearings concerning Robert Gates as director of the Central Intelligence Agency (CIA) highlight the problems evaluators share with the CIA of keeping policy imperatives out of the search for truth. The CIA at least has a structure for keeping information pure, but many evaluations do not. (SLD)

Considers individual differences in cognitive and social functioning and how and why those differences are measured. Presents some issues that are believed to be historically important to the development of testing, particularly intelligence testing, and consequently to the practice of school psychology. Discusses some continuing problems with…

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

Discusses the problems involved with both student and teacher evaluations. Examines better ways to evaluate teachers and asserts that teachers must find ways to dignify student evaluations of teachers and make the process thoughtful and reflective rather than mechanical. (PRA)

Addresses the involvement of international interest groups in defining and determining educational quality in developing countries, suggesting that global measures of quality damage the educational systems of developing countries by creating feelings of isolation and inferiority. Suggests alternative measures which meet global standards and may be…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

The education establishment's approach to set Chapter 1 standards at or near the legislative minimum for program improvement has unanticipated outcomes that do not advance the improvement effort. These outcomes and the dilemma between the negative aspects of being identified and the positive objective of program improvement are considered. (SLD)

Why conclusions of many outcome evaluations do not stand up to scrutiny is discussed, drawing on examples from evaluations of drug abuse prevention programs. Factors that undermine these studies are largely the result of social-structural problems that influence the design and implementation of the research. (SLD)

Reviews two recent professional publications concerning alternative assessment: "Portfolio Assessment in the Reading-Writing Classroom" and "Assessment and Evaluation in Whole Language Programs." (MG)

This article describes an ongoing survey that illustrates how evaluators, working with program managers, have effectively used client-based data to monitor performance in the Social Security Administration. The value of client-based data outweighs the limitations and problems collecting it. Customer perceptions are a critical barometer of quality.…

Contains a summary of the measurement strategies developed and used by the Technical Analysis Group on behalf of the National Board for Professional Teaching Standards. Also describes some remaining measurement dilemmas in the context of the National Board's assessments and suggests some areas for further research. (SLD)

In the evaluation scenario presented, that of a mentoring program matching high school juniors and seventh graders, the external evaluator is asked for impact information before enough time has elapsed to provide really meaningful data. The commentators, T. A. Schwandt and D. G. Bonnet, take different approaches to what the evaluator should do.…

Discusses three ways for teachers to affect standardized measures of student achievement: teach only students demographically predisposed to higher scores; cheat; or establish a challenging, integrative, and exploratory curriculum. (JPB)

Evaluation findings of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) Community Demonstration Program show few clear indications of the effectiveness of case management approaches. This article identifies phenomena that explain the lack of positive effects and suggests that evaluation problems may explain apparent negative…