A review of 25 technical assistance models and frameworks was conducted to identify the core elements of technical assistance practices. The focus of analysis was on generally agreed upon technical assistance practices that were considered essential for planning, implementing and evaluating the effectiveness of technical assistance. Results…

Interest from Congress, executive branch leadership, and various other stakeholders for greater accountability in government continues to gain momentum today with government-wide efforts. However, measuring the impact of research programs has proven particularly difficult. Cause and effect linkages between research findings and changes to…

The prevalence and emergence of college promise programs presents interesting and important methodological challenges. Based on their immediate access to de-identified data of applicants and enrollees, institutional researchers are in a privileged position to rigorously assess the effect of these programs in a myriad of outcomes. This study is a…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This article introduces a set of evidence-based principles to guide evaluation practice in contexts where evaluation knowledge is collaboratively produced by evaluators and stakeholders. The data from this study evolved in four phases: two pilot phases exploring the desirability of developing a set of principles; an online questionnaire survey…

Practitioners are being placed under increasing pressure to evaluate the success of their outreach activities, both by government and by their own universities. Based in a reductionist doctrine of "evidence-based practice", there is a desire to demonstrate the effectiveness and value-for-money across activities that now account for…

Several analytic strategies exist for opening up the "black box" to reveal more about what drives policy and program impacts. This article focuses on one of these strategies: the Analysis of Symmetrically-Predicted Endogenous Subgroups (ASPES). ASPES uses exogenous baseline data to identify endogenously-defined subgroups, keeping the…

In experimental evaluations of health and social programs, the role of dosage is rarely explored because researchers cannot usually randomize individuals to experience varying dosage levels. Instead, such evaluations reveal the average effects of exposure to an intervention, although program exposure may vary widely. This article compares three…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

This chapter provides a framework for grounding social justice principles at the center of learning in higher education program assessment and evaluation courses. Pedagogical reflections are drawn from the classroom experiences of three faculty of color who represent diverse institutional, programmatic, and geographic contexts. Their advanced…

An increasing number of parents are opting-out their children from high-stakes. Accountability systems in education have used students' test scores to measure student learning, teacher effectiveness, and school district performance. Students who are opted-out of high-stakes tests are not being evaluated by the state tests, making their level of…

Background: Over the past decade, there has been a shift in science, technology, engineering and math education, especially in engineering, towards a competency-based pedagogy. Competency-based learning (CBL) is an outcome-based, student-centered form of instruction where students progress to more advanced work upon mastering the necessary…

Funded grant projects all involve some form of evaluation, and Advanced Technological Education (ATE) grants are no exception. Program evaluation serves as a critical component not only for evaluating if a project has met its intended and desired outcomes, but the evaluation process is also a central feature of the grant application itself.…

Purpose: Participatory extension programmes are widely used to promote change in the agricultural sector, and an important question is how best to measure the effectiveness of such programmes after implementation. This study seeks to understand the current state of practice through a review of ex post evaluations of participatory extension…

A major challenge faced by today's faculty developers is how to move beyond the perpetual use of simplistic program evaluation practices and adopt an approach that empowers faculty developers and administrators to implement a mission-based, result-oriented program evaluation model. This article reveals the five most common elements contributing to…