A method called multi-attribute utility analysis (MAUA) provides a decision-making framework that facilitates comparative analysis of multiple real-world decision alternatives with unique complex attributes. Utility analysis as a measure of effectiveness has been minimally used by educational researchers to date, despite clear relevance in complex…

The concept of power is a complex and often intangible aspect of the evaluation process that is frequently a focal topic among the conceptual evaluation literature concerning collaborative or culturally responsive evaluation (CRE) contexts. Unfortunately, there remains a significant theory to practice gap as power is often rarely addressed or…

Evaluating initiatives implemented across multiple settings can elucidate how various contextual factors may influence both implementation and outcomes. Understanding context is especially critical when the same program has varying levels of success across settings. We present a framework for evaluating contextual factors affecting an initiative…

This essay explores the implications of the zeitgeist that emerged in the United States during the 1960s for the conceptualization of ethical issues in evaluation and community psychology, and how perspectives from the latter field might enhance ethical practice in the former. Special attention is paid to articulations of social justice,…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Health promotion and social betterment program interventions are based on either formal theory from academia or stakeholder theory from stakeholders' observations and experiences in working with clients. Over time, formal theory-based interventions have acquired high prestige, while stakeholder theory-based interventions have been held in low…

This article presents the findings of a large scale study that tested a comprehensive model of predictors of three manifestations of sustainability: continuation, institutionalization, and duration. Based on the literature the predictors were arrayed in four groups: variables pertaining to the project, the auspice organization, the community, and…

Program evaluation is recognized as an essential skill set for practitioners in service-related fields, such as education, nonprofit management, social work, and public health. Recently, the need for a public workforce trained in evaluation has increased and is driven primarily by our nation's emphasis on accountability during a time when…

In this paper we describe an evaluation training program sponsored by the Robert Wood Johnson Foundation and led by Duquesne University and OMG Center for Collaborative Learning designed to meet the challenge of developing a cadre of diverse evaluation professionals, specifically those from traditionally underrepresented or underserved…

The authors discuss the use of multiple evaluation approaches in conducting program evaluations. Specifically, they illustrate four evaluation approaches (theory-driven, consumer-based, empowerment, and inclusive evaluation) and briefly discuss a fifth (use-focused evaluation) as a side effect of the use of the others. The authors also address the…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

Examined the empowerment evaluation approach in the context of a case study of three comprehensive communities' initiatives. Considers issues related to the evaluator's role, differences relative to other inclusive evaluation approaches, stakeholder involvement, evaluation context variables, and the concept and practice of empowering program…

This article presents an interview with Katrina Bledsoe, a senior research associate with Planning, Research & Evaluation Services (PRES) Associates in Washington, D.C. Dr. Bledsoe was a faculty member in the Psychology Department at The College of New Jersey. She was trained under Stewart Donaldson at Claremont Graduate University (CGU) and…

The authors present a stakeholder-driven method, the earliest anticipated timeline of impact, which is designed to assess stakeholder expectations for the earliest time frame in which social programs are likely to affect outcomes. The utility of the anticipated timeline of impact is illustrated using an example from an evaluation of a…

Presents a planning guide that can be used to improve community-based evaluation. The guide consists of a set of questions to be discussed with all stakeholders. It covers issues of the nature and purpose of the evaluation, research methods and approaches, participation and decision making, conflict resolution, and dissemination and use of…