This paper proposes ten steps to make evaluations matter. The ten steps are a combination of the usual recommended practice such as developing program theory and implementing rigorous evaluation designs with a stronger focus on more unconventional steps including developing learning frameworks, exploring pathways of evaluation influence, and…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

The definition of a system of care (SOC) can guide those intending to develop and sustain SOCs. Hodges, Ferreira, Israel, and Mazza [Hodges, S., Ferreira, K., Israel, N., & Mazza, J. (in press). "Systems of care, featherless bipeds, and the measure of all things." "Evaluation and Program Planning"] have emphasized contexts in which services are…

For more than 20 years, the system of care philosophy has comprised a central strategy of service reform in children's mental health at the federal, state, tribal, and local levels. System of care terminology has become widely used in many different service sectors but often without a shared understanding of what a system of care is. This…

Recent reform efforts in the child welfare system have called for child welfare agencies to provide community-based services and to increase the involvement of external stakeholders in identifying and developing services within the community. At the same time, child welfare agencies are faced with the challenge of providing services to an…

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…

Activities during the initial 18-month cycle of the Demand and Resource Evaluation (DARE) Program of the Puget Sound Power and Light Company (Washington State) are described. The role of evaluation in public utility planning is discussed. Cooperation, communication, and consensus among utility planning staff are concluded to be vital. (SLD)

Discusses the conditions that promote evaluation and their applicability to the current welfare situation. Outlines a welfare reform evaluation agenda, focusing on core activities and investments in evaluation. The major focus should be finding out what is effective for which individuals. (SLD)

Illustrates the usefulness of "tree-generating" statistics for public sector service planning, focusing on the use of Automatic Interaction Detection, an early version of tree-generating statistics, to provide a model for the data analysis needed to plan substance abuse programs on a local level. (SLD)

This article describes the on-going evaluation of a pilot program characterized by: (1) cooperation between program managers and evaluators; (2) first-hand knowledge about the implementation of the pilot; and (3) a focus on summative and formative evaluations. Evaluators participated actively in the design of the pilot. (Author/SLD)

The nine articles of this special section focus on the role of evaluation in the reform of the mental health system in Washington. The reform process is described from its inception through its design to the dissemination and utilization of evaluation results. The final article considers implications for statewide evaluations. (SLD)