In the current socio-political climate, there is an extra urgency to evaluate whether program impacts are distributed fairly across important student groups in education. Both experimental and quasi-experimental designs (QEDs) can contribute to answering this question. This work demonstrates that QEDs that compare outcomes across higher-level…

Many autistic children access some form of early intervention, but little is known about the value for money of different programs. We completed a scoping review of full economic evaluations of early interventions for autistic children and/or their families. We identified nine studies and reviewed their methods and quality. Most studies involved…

Program evaluations that lack experimental design often fail to produce evidence of impact because there is no available control group. Theory-based evaluations can generate evidence of a program's causal effects if evaluators collect evidence along the theorized causal chain and identify possible competing causes. However, few methods are…

This article offers a case example of how experimental evaluation methods can be coupled with principles of design-based implementation research (DBIR), improvement science (IS), and rapid-cycle evaluation (RCE) methods to provide relatively quick, low-cost, credible assessments of strategies designed to improve programs, policies, or practices.…

The future of work is changing, providing opportunities for new careers and novel ways of working. Changes to the world of work will be driven by long-term trends such as technological and demographic change as well as the ongoing impact of the COVID-19 pandemic. Future skills requirements will increasingly emphasise interpersonal, higher-order…

The "Evaluating and Improving Teacher Preparation Programs" consensus report provides critical, evidence-based recommendations for teacher preparation program (TPP) evaluation and improvement and the systemic changes necessary to improve teaching as a profession. The report documents the extensive research that supports four groups of…

This article provides the reader with an overview of the literature relating to family support services while highlighting a number of key issues for consideration in evaluating these diverse and complex interventions. Drawing on a case example of a family support service evaluation carried out in Ireland in 2014 by the authors, this article will…

Program participants have been largely excluded as an evidence source in realist evaluations. We test whether and how lived experience as described through life history interviews with pilot program participants can be used as a valid and unique source of data for elucidating context (C)--mechanism (M)--outcome (O) configurations and informing…

Purpose: Family support programs commonly use self-sufficiency matrices (SSMs) to measure family outcomes, however, validation research on SSMs is sparse. This study examined the reliability of the Colorado Family Support Assessment 2.0 (CFSA 2.0) to measure family self-reliance across 14 domains (e.g., employment). Methods: Ten written case…

A review of 25 technical assistance models and frameworks was conducted to identify the core elements of technical assistance practices. The focus of analysis was on generally agreed upon technical assistance practices that were considered essential for planning, implementing and evaluating the effectiveness of technical assistance. Results…

Interest from Congress, executive branch leadership, and various other stakeholders for greater accountability in government continues to gain momentum today with government-wide efforts. However, measuring the impact of research programs has proven particularly difficult. Cause and effect linkages between research findings and changes to…

States are incorporating evaluation ratings into new, multioutcome teacher preparation program (TPP) evaluation systems, yet little is known about the relationships between TPPs and the evaluation ratings of program graduates. To address this gap, we use teachers' ratings on the North Carolina Educator Evaluation System to determine whether TPPs…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

It is necessary for public managers to be able to evaluate programmes in the context of complexity. This article offers key learning and reflections based on the experience of facilitating the evaluation of complexity with a range of public sector partners in Scotland. There have been several articles that consider evaluating complexity and…