This article describes lessons learned about implementing evaluations in hospital settings. In order to overcome the methodological dilemmas inherent in this environment, we used a practical participatory evaluation (P-PE) strategy to engage as many stakeholders as possible in the process of evaluating a clinical demonstration project.…

Major advances in the number, capabilities, and quality of state, national, and transnational databases have opened up new opportunities for evaluators. Both large-scale data sets collected for administrative purposes and those collected by other researchers can provide data for a variety of evaluation-related activities. These include (a)…

The use of theory-driven evaluation is an emerging practice in the military--an aspect generally unknown in the civilian evaluation community. First developed during the 1991 Gulf War and applied in both the Balkans and Afghanistan, these techniques are now being examined in the North Atlantic Treaty Organisation (NATO) as a means to evaluate the…

In recent years, there has been increasing attention to the importance of interagency collaboration for improving community well-being, environmental and public health, and educational outcomes. This article uses a mixed-methods approach including network analysis to examine the changes in interagency collaboration in one site funded by the Safe…

All evaluators face the challenge of striving to adhere to the highest possible standards of ethical conduct. Translating the AEA's Guiding Principles and the Joint Committee's Program Evaluation Standards into everyday practice, however, can be a complex, uncertain, and frustrating endeavor. Moreover, acting in an ethical fashion can require…

This article describes how job analysis, a method commonly used in personnel research and organizational psychology, provides a systematic method for documenting program staffing and service delivery that can improve evaluators' knowledge about program operations. Job analysis data can be used to increase evaluators' insight into how staffs…

Describes how Geographic Information Systems (GIS) can be used to help evaluators convey complex information simply through a spatial representation. Demonstrates how GIS can be used to plot change over time, including impact and outcome data gathered by primary data collection. (SLD)

Discusses qualitative methods of impact analysis and provides an introductory treatment of one such approach. Combines an awareness of an alternative causal epistemology with current knowledge of qualitative methods of data collection and measurement to produce an approach to the analysis of impacts. (SLD)

Describes an evaluator's experiences constructing a World Wide Web site to collect evaluation data and discusses the technical and design challenges presented by data collection via the Web. Discusses eight lessons of Web-based data collection and outlines the advantages of the approach. (SLD)

Explores the effects evidence-based practice and the guideline movement will have on evaluation in the future and discusses the impact on evaluation of three aspects of the current information revolution: (1) e-government; (2) new approaches to data access; and (3) real-time evaluation. Also considers the sources of evaluation innovation and the…

Discusses the methodology and content of the evaluation of the Homeless Families Program. Focuses on data collection and the determination of program outcomes. Stresses the importance of stakeholder involvement and the flexibility of the evaluators as the evaluation unfolded. (SLD)

The Delphi technique permits the collection of rich evaluation data. Benefits of using the Delphi include the collection of data that is generated by participants with minimal leading by researchers, an iterative process that demonstrates to participants how their ideas and opinions are being utilized in the research process, and a planned…

The paper discusses two common scenarios in which evaluators must conduct impact evaluations when working under budget, time, or data constraints. Under the first scenario the evaluator is not called in until the project is already well advanced, and there is a tight deadline for completing the evaluation, frequently combined with a limited budget…

This article describes results of a study investigating the potential of using social network analysis to evaluate programs that aim at improving schools by fostering greater collaboration between teachers. The goal of this method is to use data about teacher collaboration within schools to map the distribution of expertise and resources needed to…

In the present climate of public accountability, there is increasing demand to show "what works" and what return is gained for the public from investments to improve communities. This increasing demand for accountability is being met with growing confidence in the field of philanthropy during the past 10 years that the impact or effectiveness of…