Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

The need for higher enrollment, along with a greater focus on educational access and making college more accessible has created an urgent need for community colleges and universities to develop retention and persistence strategies for students who are not prepared academically and may lack the resources to be successful in college (Bailey &…

The value of a program can be understood as referring not only to outcomes, but also to how those outcomes compare to the types and amounts of resources expended to produce the outcomes. Major potential mistakes and biases in assessing the worth of resources consumed, as well as the value of outcomes produced, are explored. Most of these occur…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

In this report the Brown Center on Education Policy at the Brookings Institution presents the results of a self-developed Education Choice and Competition Index (ECCI) along with an interactive application that grades large school districts according to the ECCI. The index is composed of 13 pro choice criteria. The authors present the ECCI as a…

The study describes an evaluation of a 48-week physical activity and nutritional education programme for overweight/obese school-age children using quantitative and qualitative methods. The majority of participants were obese or severely obese when enrolled, and while some improvements in body mass index, self-esteem and engagement in a range of…

This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

In this paper, the author considers certain aspects of the problem of obtaining unbiased information about the merits of a program or product, whether for purposes of decision making or for accountability. The evaluation of personnel, as well as the evaluation of proposals and evaluations, generally involves a different set of problems than those…

In response to rising rates of firearms violence that peaked in the mid-1990s, a wide range of policy interventions have been developed in an attempt to reduce violent crimes committed with firearms. Although some of these approaches appear to be effective at reducing gun violence, methodological variations make comparing effects across program…

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

Written as four scenes that span a five-year period, this article examines the summative evaluation of an organized school reform programme in the United States from the teacher perspective. The study provides fine-grained details of how the evaluation of the particular reform effort went "awry" in the view of some teachers who directly…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…