Good theory development is grounded in empirical inquiry. In the context of educational evaluation, the development of empirically grounded theory has important benefits for the field and the practitioner. In particular, a shift to empirically derived theory will assist in advancing more systematic and contextually relevant evaluation practice, as…

This article describes three challenges encountered during a developmental evaluation and explains how these were addressed from the evaluators' perspective. The evaluation was conducted to support the implementation of a three-year educational technology leadership project funded by the Alberta provincial government. The developmental evaluation…

Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such…

External information is commonly collected for, and provided to, evaluation stakeholders without giving due consideration to their precise needs. As a result, evaluation resources are often inefficiently consumed and the impact of the evaluation process is diminished. The External Information Search and Formatting (EISF) process is a new approach…

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

Evaluators know they are supposed to identify and engage with stakeholders. What happens when the client has a very narrow concept of the meaning of evaluation? What happens when the primary stakeholders, including the client, disappear just as the evaluation gets started? First, it is important to acknowledge the challenge, then develop a…

This article describes an evaluation that was judged to be unsuccessful from the point of view of key program stakeholders. This was due to the fact that the evaluation did not support program advocates who had much to gain from positive evaluation findings. We argue that, although the knowledge needs of stakeholders must be taken into account,…

According to the literature published on the topic, the development of an organization's capacity to do and use evaluation typically follows four stages: "traditional evaluation," characterized by externally mandated evaluation activities; "awareness and experimentation," during which organizational members learn about evaluation and its benefits…

In the domain of school-based tobacco control, there is a large gap between the research being performed and the type of research needed to inform school-based prevention activities. The tobacco module of the school health action planning and evaluation system is a data collection and feedback system designed to support school-based tobacco…

Given today's climate of economic uncertainty and fiscal restraint, organizations providing child and youth mental health services are required to do so with limited resources. Within this context, service providers face added pressure to deliver evidence-based programs and demonstrate program effectiveness. The Ontario Centre of Excellence for…

The purpose of this article is to describe evaluation capacity building using an immersion approach in two schools: one with an administrator-led process and one with a teacher-led process. The descriptions delineate conceptual, developmental, and sustainability aspects of capacity building through the perspectives of the teachers, principals, and…

Despite increasing interest in the integration of evaluative inquiry into organizational functions and culture, the availability of empirical research addressing organizational capacity building to do and use evaluation is limited. This exploratory descriptive survey of internal evaluators in Canada asked about evaluation capacity building in the…

Examines the theoretical foundations of the belief that stakeholder involvement empowers the stakeholders and increases evaluation utilization and the validity of the evaluation. Discusses conditions under which these benefits are realized and situations in which they are not. (SLD)

Defines causal-model evaluation and uses an example from the crime prevention literature to contrast this approach with traditional evaluations. Discusses benefits and limitations of the approach, as well as other issues. (SLD)

Studied the convergence of evaluator and non-evaluator perspectives about collaborative evaluation. Results based on work of 67 pairs of evaluators and program practitioners show that, generally, program practitioners were more conservative in their opinions. Many differences in the two perspectives are noted. (SLD)