Today's public policy discussions increasingly focus on how "networks" of public and private actors collaborate across organizational, sectoral, and geographical boundaries to solve increasingly complex problems. Yet, many of evaluation's key concepts, including the evaluator's role, assume an evaluand that is programmatically or organizationally…

"Voice" is widely considered to be a feature of effective writing. It's no surprise, then, that voice criteria frequently appear on rubrics used to score student essays in large-scale writing assessments. However, composition theorists hold vastly different views regarding voice and how it should be applied in the evaluation of student writing, if…

This paper is a reflection on practice. It begins by briefly describing an evaluation of an externally-funded education programme in Kosovo (a new country in south-east Europe). The programme was managed by Save the Children in Kosovo and aimed to develop and promote models of inclusive education through three strands of activity. The first of…

The Case of Top Beginnings and the Missing Child Outcomes is a fictionalized case study of a set of evaluation challenges faced in evaluating comprehensive initiatives that are seeking to build systems. In this case, the issue is a multistate foundation-funded early learning system building initiative that has to date primarily employed a case…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

The misuse of evaluation is discussed. Boundaries of misutilization are not well understood, and distinctions between misutilization and non-use or abuse are not clear. In general, the responsibility for evaluation misuse is with the user, while the responsibility for misevaluation is with the evaluator. A distinction is also needed between…

In this collection, evaluation theorists and practitioners consider evaluator role and identity in evaluation theory, practice, and society. The chapters are: (1) "Three Frameworks for Considering Evaluator Role" (Jean A. King and Laurie Stevahn); (2) "Toward Better Understanding of Alternative Evaluator Roles" (Melvin M. Mark); (3) "Making (More)…

Discusses ethical challenges faced by evaluators, especially those who have gotten into problems while conducting the evaluation. Introduces the other articles in this theme section. (SLD)

Challenges the assumption that evaluation should aim for fostering deliberative democracy. A modest effort by an evaluator to contribute to deliberative democracy is defensible, but vigorous political advocacy violates social expectation. (Author/SLD)

Whether there can be professional reasons for turning down an evaluation contract is explored. Considering how evaluations can promote either guild maintenance interests or societal improvement interests illuminates several dilemmas in the proper conduct of evaluation and suggests the need for greater explicit attention to what it means for the…

Values and beliefs underlying assumptions concerning the independent evaluations of persons and programs involved in the educational process are discussed. Particular emphasis is placed on M. Scriven's treatise on bias in evaluation (1976). Works by E. R. House, R. E. Stake, L. Stenhouse, M. Parlett and D. Hamilton, and D. L. Stufflebeam are also…

Outlines a scenario in which an evaluator wants to ask questions of teenagers that may pose ethical problems, or may be perceived as posing such problems. The hypothetical situation is the evaluation of a life skills program aimed at reducing the teen birth rate. (SLD)

Three commercial job evaluation firms rated the same set of 27 jobs. Statistical analysis indicated that evaluators differed in which job traits they used to evaluate inherent job worth. Comparable worth may thus be sensitive to the choice of evaluator. (Contains 24 references.) (Author/SK)

Taking the position that science is not value-free has certain consequences. There are both risks and rewards inherent when evaluators relinquish an objective, non-involved role for a more subjective, partisan role in an evaluation where issues of class, gender, and race are intertwined. It is important for evaluators to consider how their…

Suggests that the key issue in the evaluation problem scenario is not so much an ethical problem as it is a strategic problem. The evaluator needs to be educator, change agent, and organizational development practitioner to make this evaluation a success. (SLD)