Since the beginning of the 21st century, evaluability assessments have experienced a resurgence of interest. However, little is known about how evaluability assessments have been used to improve future evaluations. In this article, we identify characteristics, challenges, and opportunities of evaluability assessments based on a scoping review of…

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

This study examines two community college instructional support programs to explore the effectiveness of an evaluation model--responsive evaluation theory--that may ease the tensions between a concern over programs' processes and reporting requirements for program outcomes. The study uses a comparative qualitative case study design and applies…

Today's public policy discussions increasingly focus on how "networks" of public and private actors collaborate across organizational, sectoral, and geographical boundaries to solve increasingly complex problems. Yet, many of evaluation's key concepts, including the evaluator's role, assume an evaluand that is programmatically or organizationally…

To conduct evaluations that can benefit individual programs as well as the field as a whole, environmental educators must have the necessary evaluation competencies. This exploratory study was conducted to determine to what extent a self-directed learning resource entitled "My Environmental Education Evaluation Resource Assistant" (MEERA) can…

Dynamics of a large, expensive, and controversial surface and underground evaluation of a radioactive waste management program at the Yucca Mountain power plant are reviewed. The use of private contractors in the quality assurance study complicates the evaluation. This case study illustrates high stakes evaluation problems. (SLD)

This manual is intended for managers of training and institutional development programs. Its objective is to provide clear and practical advice for those who conduct impact evaluations. Impact evaluation is distinguished from other types of evaluation by the area of the program on which it focuses, the assessment of the extent to which a program…

A year-long case study of the effects of an educational and vocational rehabilitation program in a youth training center was discussed in terms of fourteen issues which might threaten the validity of an evaluation or research project. This correctional institution housed women aged 14 to 21 who were long-term wards of the state, held on remand, or…

Rather than automatically presuming explicit conditions exist when designing an evaluation to fit the summative or formative mold, evaluators should think of an evaluation design as fitting between endpoints on an evaluation process continuum. Evaluators can blend techniques from both the formative and summative evaluation, matching actual program…

This case study describes an unsuccessful research proposal submitted in response to a request for applications for projects to implement and evaluate up to 18 innovative programs for homeless persons with alcohol or other drug problems. This unsuccessful proposal reflects several tensions inherent in evaluation research. (SLD)

Assesses, using the Urban Development Action Grant as a case study, why the evaluation of American urban economic initiatives has declined. The authors conclude that this decline occurred because of such evaluation's perceived lack of utility for policymakers and ineffectiveness in actually informing either policy or practice. The problems…

In 1989 the Department of Education contracted with Development Associates, Inc., to conduct a review of the evaluation and improvement practices of projects funded under Title VII of the Elementary and Secondary Education Act, often known as the Bilingual Education Act. The study focused on local transitional bilingual education and special…

The general decline in public resources has encouraged government agencies to consolidate job functions, and the internal program evaluator is becoming a scarce commodity. This paper briefly describes a case study about the circumstances and implications of merging two formally antagonistic job roles: program administrator and program evaluator.…