In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

The National Institute of General Medical Sciences (NIGMS) mandates that its Centers of Biomedical Research Excellence (COBRE) and Institutional Development Award Networks of Biomedical Research Excellence (INBRE) institute formal mentoring programs to promote the core program objective of junior investigator development. Despite this NIGMS…

Coach development programs (CDPs) are important, but significantly under-researched and poorly understood, elements in the preparation of sport coaches. This paper draws on the author's experience of carrying out five program evaluations of CDPs in the United Kingdom. Each program evaluation was based on an evaluation model that focused on…

Photovoice is an empowering, qualitative, community-based participatory research method that engages participants to take photographs and reflect on their meanings. We employed a novel application of a Photovoice-inspired methodology to evaluate perinatal home visiting services. This article describes the feasibility and utility of remote…

Purpose: Assessment of agricultural advisory services is crucial to improve their quality and effectiveness. Farmer Field Schools (FFS) have been adapted to meet context specific needs in crop or farm management. This article investigates whether the diversity of FFS interventions is reflected in the assessment methods used to evaluate them.…

Since the beginning of the 21st century, evaluability assessments have experienced a resurgence of interest. However, little is known about how evaluability assessments have been used to improve future evaluations. In this article, we identify characteristics, challenges, and opportunities of evaluability assessments based on a scoping review of…

In the current socio-political climate, there is an extra urgency to evaluate whether program impacts are distributed fairly across important student groups in education. Both experimental and quasi-experimental designs (QEDs) can contribute to answering this question. This work demonstrates that QEDs that compare outcomes across higher-level…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

Many autistic children access some form of early intervention, but little is known about the value for money of different programs. We completed a scoping review of full economic evaluations of early interventions for autistic children and/or their families. We identified nine studies and reviewed their methods and quality. Most studies involved…

Meaningfully engaging faculty in assessment presents a continual challenge for general education administrators. Faculty perceptions of assessment--including that assessment serves no purpose other than "checking a box" for accreditation and that it conveys little benefit to the instructor--often hinder instructor engagement. A low-cost…

Culturally responsive approaches to evaluation are emerging across diverse program and community contexts to address increasingly intractable social, economic, political, and environmental concerns. Despite the sense of urgency, responsibility, and moral obligation motivating the use of these approaches, however, empirical research on the…

Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of…

As is the case with many Centres for Teaching and Learning, prior to the global health crisis in 2020 our Centre primarily obtained feedback to inform its programming based on participation and satisfaction. As a result of the crisis, we could not rely on previous sources of information and needed to implement new strategies for evidencing the…

Social return on investment (SROI), an evaluation method that compares monetized social value generated to costs invested, is in ascendance. Conceptually akin to cost-benefit analysis, it shares some of its challenges; however, these are heightened due to the expressed promise of using SROI to compare programs and inform philanthropic and public…

In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…