One of the biggest challenges that states and local intermediaries face in setting up and scaling high-quality youth apprenticeships is gathering relevant, accurate and actionable data. High-quality data is an essential ingredient for a strong youth apprenticeship program because it equips state and local leaders to evaluate impact, monitor…

Purpose: The firms use training evaluation practices (TEPs) to determine the return of billions of dollars spent on employee training and development activities. The firms need to modernize the set of TEPs for evidence-based workforce management decisions. This study aims to examine a mediation mechanism to explain how human resource (HR)…

Students in a master's-level graduate course in school counseling program evaluation conducted a qualitative research study to investigate school counselors' experiences with evidence-based program delivery and evaluation. We discuss the study's findings that illuminated themes of challenges faced by school counselors with implications for…

Bhutan's overarching development paradigm of Gross National Happiness (GNH) promotes a harmonious balance between material and non-material dimensions. But Bhutan's evaluation practice has not yet adopted the principles of GNH, preventing evaluation findings and recommendations from aligning with the priorities of GNH. This article makes the case…

Teachers who work with students who display challenging behaviors need to implement interventions to support them in the classroom. A daily behavior report card (DBRC) is one intervention that research suggests can reduce challenging behaviors and replace them with more socially appropriate behaviors. With step-by-step instructions, this column…

Analysis of symmetrically predicted endogenous subgroups (ASPES) is an approach to assessing heterogeneity in an ITT effect from a randomized experiment when an intermediate variable (one that is measured after random assignment and before outcomes) is hypothesized to be related to the ITT effect, but is only measured in one group. For example,…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

Institutions of higher education are required by U.S. accrediting bodies to articulate their conceptual framework and develop a viable program improvement plan through a continuous reflective process of progressive problem solving that enables data-driven decision-making practices. To meet or exceed national accreditation standards for leadership,…

We assessed whether an adaptation of value-added analysis (VAA) can provide evidence on the relative effectiveness of interventions implemented in a large school district. We analyzed two datasets, one documenting interventions received by underperforming students, and one documenting interventions received by students in schools benefiting from…

We assessed whether an adaptation of value-added analysis (VAA) can provide evidence on the relative effectiveness of interventions implemented in a large school district. We analyzed two datasets, one documenting interventions received by underperforming students, and one documenting interventions received by students in schools benefiting from…

Across OECD countries, the increasing demand for evidence-based policy making has further led governments to design policies jointly with clear measurable objectives, and to define relevant indicators to monitor their achievement. This paper discusses the importance of such indicators in supporting the implementation of education policies.…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

Though we have recently witnessed the "exponential production of digital data to measure, analyze, and predict educational performance" (Salajan & Jules, this volume), there has not been sufficient attention given to the quantitative methods that are used to process and transform this data in order to arrive at findings related to…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

This article develops a machine learning methodology to analyse the relationship between university accreditation and student experience. It is applied to 98 university accreditations conducted by the Quality Assurance Agency (QAA) in the UK in 2012-2018, and 263,025 university ratings in three categories posted by students on the website…