"Integrative evaluation" is an approach with two main phases: identification of plausible rival hypotheses and integration of rival hypotheses. The first phase may correspond to traditional adversary evaluation, whereas the second phase, that is not included in adversary evaluation, requires integrative thinking which can be applied when…

Problem definition in program planning and evaluation is rarely problematized. In this article, I discuss why the lack of problem problematization is itself problematic--in other words, why treating problems as self-evident can pose a risk for evaluation practice. Then, to help avoid such risks, I suggest Carol Bacchi's "What's the Problem…

This article explores the utility of mindfulness in the field of evaluation. Mindfulness is a translation of the ancient Indian word, "Sati," which means awareness, attention, and remembering. While definitions vary, a practical definition of mindfulness is present-moment awareness in an open and nonjudgmental manner. Mindfulness-based…

For over 30 years, calls have been issued for the western evaluation field to address implicit bias in its theory and practice. Although many in the field encourage evaluators to be culturally competent, ontological competence remains unaddressed. Grounded in an institutionalized distrust of non-western perspectives of reality and knowledge…

Expert intuition is increasingly considered to be a valid form of knowledge, and research has proven its effectiveness in judgment and decision making in various fields. Theorists seem to recognize the contributions of intuition within evaluative practice, but it has never been well-documented. This article presents a study on expert intuition,…

Evaluation practices are continuing to evolve, particularly in those areas related to formative, participatory, and improvement approaches. Improvement science is one of the evaluative practices. Its strength is that it seeks to embrace stakeholders' and frontline workers' knowledge and experience, who are often tasked with leading improvement…

Within the context of intentional collaboration between doctoral-level program evaluation and counselor educators, this article addresses the need for advanced training in program evaluation for preservice doctoral-level counselor education (CE) students. To determine the current level of evaluation training provided to doctoral students attending…

Evaluative thinking (ET) is an increasingly important topic in the field of evaluation, particularly among people involved in evaluation capacity building (ECB). Yet it is a construct in need of clarification, especially if it is to be meaningfully discussed, promoted, and researched. To that end, we propose that ET is essentially critical…

The concept of values is the central concept in evaluation. There are several ways of looking at values, including from the perspectives of philosophy, psychology, sociology, biology, and biography. In this article Ernest House discusses how values are conceived in cognitive psychology and what that means for evaluation. Further, he discusses the…

This article introduces a set of evidence-based principles to guide evaluation practice in contexts where evaluation knowledge is collaboratively produced by evaluators and stakeholders. The data from this study evolved in four phases: two pilot phases exploring the desirability of developing a set of principles; an online questionnaire survey…

In this commentary, Gary Henry explains that the Danes have got it right, again. Not only is their voter turnout high to begin with, but they are evaluating ways to increase voter turnout with "random variation" to accurately assess the effects of the innovations. In the Danish 2009 municipal elections, 65.8% turned out to vote, which…

Much has been said in literature about the changing face of development and the changing face of the aid industry. However, the focus of this article is the effect that this could have on evaluation and what might be done to move evaluation into the most useful space possible. Herein, the author makes the case that the evaluation community needs…

Democratic institutions often do not evaluate their instruments. By working closely with authorities, we developed a field experiment to examine an initiative to increase voter turnout among 18-year-olds that had not previously been evaluated. Particular attention was paid to developing an appropriate program theory and to designing the evaluation…

Imagine a world where evaluation is a social epidemic . . . where individuals, groups, organizations, and communities are constantly learning about and from evaluations. The author believes that we are well on our way to creating a "global cascade" of evaluative thinking and practice. Evidence of this phenomenon can be seen in the field's…

As with many forms of evaluation, empowerment evaluation can be viewed as an ideology that promotes a particular set of social and professional values. Judging the quality and utility of empowerment evaluation thus requires a critical appraisal of the implications of adopting those values.