Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

Describes the development of a pilot uniform data set (UDS) intended to serve as the primary data collection mechanism for all grants and standard cooperative agreements funded by the U.S. Office of Minority Health. The UDS is the product of a formative research project with implications for other program evaluations. (SLD)

Identified methods that six federal agencies reported using to verify and validate performance data used in complying with the requirements of the Government Performance and Results Act. Developed a framework containing four major approaches to assessing and improving data quality. (SLD)

Describes the use of the program logic model as an integrative framework in the multimethod evaluation of a middle school curriculum delivery program. Shows how the logic model was used to focus data collection, organize data, and interpret the data in an integrative framework. Focuses on the area of computer skills to illustrate the usefulness of…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

The concept of evaluation readiness complements other evaluation planning approaches. Its basic products are the formal program definition and the data inventory framework. Ways to improve timeliness, appropriateness, and use of evaluation are also discussed. (Author/GDC)

Many evaluation researchers are now attempting to synthesize quantitative and qualitative approaches. Although such efforts appear to carry great promise, some subtleties and incompatibilities of these approaches are perhaps being overlooked. Implications for social inquiry are discussed. (Author/GDC)

The rationale for a multistage approach to evaluating services demonstration programs is discussed. The approach takes into account limitations that are often found in such programs. The National Evaluation of Models for Linking Drug Abuse Treatment and Primary Care provides an example. (SLD)

A questionnaire is designed to allow assessment of a simple additive value function for testing respondent preferences for different types of information used in evaluating police services. Responses are analyzed to determine what types of information different stakeholder groups consider useful. (Author/LMO)

The government attempted to set up a viable management information and feedback system for evaluating accountability in services delivery. Conceptual models for agency goals and services delivery were designed and measures were developed in the provision of leisure and recreational services. Two citizen surveys are described. (Author/CTM)

Factors involved in pre-planned and post-planned evaluation of program effectiveness are compared: (1) reliability and cost of data; (2) internal and external validity; (3) obtrusiveness and threat; (4) goal displacement and program direction. A model to help program administrators decide which approach is more appropriate is presented. (Author/MH)

Strasser and Deniston's own analysis (TM 504 254) shows that post-planned evaluations are unsuitable substitutes for pre-planned evaluations. When viewed as post-experimental interviews, however, post-planned evaluations can produce valuable information which complements traditional experimental and quasi-experimental evaluations. (MH)

A between method triangulation strategy was used to evaluate a process for long-range program planning. One study team conducted interviews and the other used a mail questionnaire. The resulting problems in coordination between teams are discussed. (Author/GDC)

Conditions influencing conduct and impact of state-level program evaluation are explored. A model is offered as a guide for assessing conduct and impact, and its use is demonstrated by a case study contrasting the approaches of two states examining an issue raised by the Federal Health Care Financing Agency. (SLD)