This paper proposes ten steps to make evaluations matter. The ten steps are a combination of the usual recommended practice such as developing program theory and implementing rigorous evaluation designs with a stronger focus on more unconventional steps including developing learning frameworks, exploring pathways of evaluation influence, and…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

The definition of a system of care (SOC) can guide those intending to develop and sustain SOCs. Hodges, Ferreira, Israel, and Mazza [Hodges, S., Ferreira, K., Israel, N., & Mazza, J. (in press). "Systems of care, featherless bipeds, and the measure of all things." "Evaluation and Program Planning"] have emphasized contexts in which services are…

For more than 20 years, the system of care philosophy has comprised a central strategy of service reform in children's mental health at the federal, state, tribal, and local levels. System of care terminology has become widely used in many different service sectors but often without a shared understanding of what a system of care is. This…

Recent reform efforts in the child welfare system have called for child welfare agencies to provide community-based services and to increase the involvement of external stakeholders in identifying and developing services within the community. At the same time, child welfare agencies are faced with the challenge of providing services to an…

Social work and child welfare practitioners have long confronted the reality that child maltreatment and domestic violence often coexist within families. However, services for the victims of these types of family violence have been fragmented, forcing victims to go to multiple agencies for assistance. The purpose of this paper is to describe the…

The catalytic potential of community-based organizations to promote health, prevent disease, and address racial, ethnic, and socio-economic disparities in local communities is well recognized. However, many CBOs, particularly, small- to medium-size organizations, lack the capacity to plan, implement, and evaluate their successes. Moreover, little…

The purposes of this study were to evaluate a federal and state-funded Family Caregiver Support Program (FCSP) and explore what types of caregiver support service are associated with what caregiver outcomes. Information was obtained on a sample of 164 caregivers' use of eleven different types of support service. Descriptive and comparative…

The concept of quality of life (QOL) is increasingly being used in the field of intellectual disabilities as a conceptual and measurement framework for program planning and evaluation. This article describes the development of a QOL conceptual and measurement framework, and summarizes how this framework is currently being used both nationally and…

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this…

In 2003 foster youth employed by a foster youth advocacy organization suggested that an evaluation of group home services to foster youth be conducted in Alameda County, California. This report presents the development and conduct of this evaluation study; how funding was obtained; and how foster youth were hired, trained, and employed to produce…

Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been…

The traditional view that an activity's comparative impact on collective welfare ought to guide resource allocation is refuted. A paradigm of a multisystem society with the non-fungibility of investment resources an essential issue in project appraisal is presented. (SLD)

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…

This article describes standards setting in an evaluation of the structure of 15 of the nation's university hospitals who participated in the Teaching Hospital General Medicine Group Practice Program. Standards were (1) selected from many sources; (2) formed in a participatory, competing forum for discussion; and (3) set in advance of information…