Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

In this paper, the author considers certain aspects of the problem of obtaining unbiased information about the merits of a program or product, whether for purposes of decision making or for accountability. The evaluation of personnel, as well as the evaluation of proposals and evaluations, generally involves a different set of problems than those…

The role and methods of an evaluator of program effectiveness are discussed. Responses to questions prepared by academicians were obtained from three evaluation practitioners; an external, independent evaluator; and an internal evaluator with program implementation responsibilities. Practitioners uniformly indicated that internal evaluators were…

Based on experiences in conducting program evaluations for the Canadian Federal Government, an evaluator addresses reconciliation of the information needs of managers and accountability. External and internal accountability are covered. Using the perspectives of both line managers and senior managers, means of resolving pertinent issues are…

This briefing report on program evaluation notes that the new wave of family-centered, integrated services is forcing the field to rethink its methodology, and that the move towards outcome-driven reforms requires carefully defined outcomes and ways to measure them. Highlights of a seminar meeting held to explore these issues are included. The…

This paper examines whether the Title I/Chapter 1 tradition of leading the way in educational evaluation will continue or whether Chapter 1 will change its role by delegating decision-making authority over evaluation methodology to state and local school systems. Whatever direction Chapter 1 takes, states, school systems, and schools must be held…

This paper examines the issues arising when a set of federally funded model demonstration projects, the secondary curricula/student transition projects of the Office of Special Education and Rehabilitative Services, were obligated by federal initiative to improve the amount, quality, and use of evaluation. These issues included: (1) the nature of…

Discussions were held with administrative staff and evaluators from the New York City Public Schools in order to identify sources of data for evaluating special education programs. Data which are generally available include: (1) citywide reading test scores; (2) number of diplomas issued; (3) number of students decertified; (4) number of students…

Implementation of schoolwide projects in Philadelphia (Pennsylvania) illustrates some of the conceptual problems associated with the Hawkins Stafford accountability amendments to the Chapter 1 supplementary education program. Unintended negative consequences are discussed, and recommendations are made to overcome these problems, including the…

Using a system that monitors just the process of education does not guarantee positive student outcomes. What education needs is a consistent set of accountability procedures for all students. As educators take steps toward a new and inclusive accountability system, they need to look at: (1) possible alternative approaches to accountability; (2)…

This document is comprised of the three 2002 issues of a newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The Spring issue focuses on family support evaluations and their role in advancing the field of family support and includes…