Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

The terms "outcome" and "impact" are ubiquitous in evaluation discourse. However, there are many competing definitions that lack clarity and consistency and sometimes represent fundamentally different meanings. This leads to profound confusion, undermines efforts to improve learning and accountability, and represents a…

Theory of change (ToC) is currently "the" approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC's focus on cause-effect logic and intended outcomes does not do justice to the recursive nature…

As global discussions of evaluation standards become more contextually nuanced, culturally responsive conceptions of ethics have not been sufficiently discussed. In academic social research, ethical clearance processes have been designed to protect vulnerable people from harm related to participation in a research project. This article expands the…

Participatory monitoring and evaluation (PME) is an approach that higher education institutions should use to ensure achievement of objectives especially quality academic programs, research, consultancies, outreach services and administrative functions. Indeed, over the past 10 years PME has gained increased prominence over more conventional…

The provision of all-female computer science outreach programmes is a common strategy used to foster greater interest in the subject for high school aged girls. Based on key factors that affect girls' interest in computer science (CS), outreach programmes often share much in their approach. Nonetheless, there is criticism from a research…

Most states are using a multi -tiered system of supports (MTSS) or response to intervention (RTI) framework for improving the quality of instruction for all students and addressing the needs of students at risk for poor learning outcomes. Supporting educators in using tools to calibrate their MTSS/RTI implementation to the state's expected…

Donald Kirkpatrick published a series of articles originating from his doctoral dissertation in the late 1950s describing a four-level training evaluation model. From its beginning, it was easily understood and became one of the most influential evaluation models impacting the field of HRD. While well received and popular, the Kirkpatrick model…

This study demonstrates the importance of Rasch Measurement Theory (RMT) in program evaluation when outcome measures need to be constructed from scratch. The paper introduces typical measure validation methods presented in program evaluation texts and discusses room for improvement. The study then illustrates how the seamless transitions from…

Vocational high school graduates are expected to readily enter the work field, nevertheless, the number of unemployment from vocational high school graduates is still big. Optimizing a career guidance service requires complete evaluation feedback. In detail, this research aims to: identifying a construct instrument applicable to evaluate a career…

The purpose of the 2018-2019 CARES evaluation was to (a) help program staff conceptualize the CARES implementation work and goals; (b) define measurable indicators of implementation, outputs, and outcomes; and (c) provide summative data on the first year of program implementation. Results of the 2018-2019 CARES program evaluation activities were…

Amid rising college tuition, low college-completion rates, and ever-changing employer demands for specialized skills, new forms of postsecondary education are gaining prominence. These "nontraditional" programs (such as coding boot camps) are typically short in duration and designed to prepare students for a particular occupation or…

Though we have recently witnessed the "exponential production of digital data to measure, analyze, and predict educational performance" (Salajan & Jules, this volume), there has not been sufficient attention given to the quantitative methods that are used to process and transform this data in order to arrive at findings related to…

This white paper offers an approach for using a theory of action as an outline to develop the State Systemic Improvement Plan (SSIP) Phase II evaluation questions and plan that will guide the SSIP work in Phase III and beyond. Key areas of focus include generating evaluation questions at each level of outcomes, identifying essential steps and…