Many children are attending after-school programs for various reasons, such as academic support, recreational play, and social interaction. Accompanied by high parental demands for affordable child-care, after-school program participation has increased significantly. The issue of quality care becomes important as the number of children enrolled in…

This article reflects on the evaluation of an innovative educational arts project at a primary school in Liverpool. Based on an animated film version of Janácek's "Cunning Little Vixen," an opera populated by animals, this child-led project was considered to be a successful endeavour. Yet there remain unanswered questions over how this…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

Duplicating processes and procedure with anticipation of deviating outcomes is the defining trait of insanity as attributed to a quote by Albert Einstein. It is the antithesis to innovation, which is what is needed in higher education to create impactful changes in the outreach we should be providing to the community. What is important for those…

The leadership of school principals is widely considered to have a strong influence on the quality of teaching and learning in schools. University-based leadership preparation programs have the responsibility for preparing candidates to serve as school principals and in other leadership capacities. This qualitative study of educational leadership…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

Purpose: Participatory extension programmes are widely used to promote change in the agricultural sector, and an important question is how best to measure the effectiveness of such programmes after implementation. This study seeks to understand the current state of practice through a review of ex post evaluations of participatory extension…

Understanding resources available in a community is essential before any 4-H youth development professional can begin addressing local needs. Conducting a community assessment generates valuable information about the unique components and resources of a specific community. This information then provides a foundation for identifying specific…

From a utilization-focused evaluation perspective, the success of an evaluation is rooted in the extent to which the evaluation was used by stakeholders. This paper details the "Expectations to Change" (E2C) process, an interactive, workshop-based method designed to engage primary users with their evaluation findings as a means of…

The U.S. Department of Education (ED) expects all Teacher Incentive Fund (TIF) grantees to conduct an evaluation of their programs. Experience with earlier rounds of TIF grants has shown that evaluations can provide valuable information for managing and improving TIF-supported activities, as well as evidence that these activities have had a…

Individual instructor consultation is a common service provided by centers focused on educational development in higher education. The importance of this service has been reflected in its history, increasing demand, and strong anecdotal evidence to its effectiveness. However, the extant literature reveals that comprehensive assessment of…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…