Qualitative interviews and focus groups are commonly used methods to elicit participants' voices in program evaluations. However, the use of these data-gathering methods can fall short of the goal; even with open-ended questions, the protocols guiding and shaping interviews and focus groups heavily reflect the evaluators' understanding and…

In 2018, the United States Congress passed the "Strengthening of Career and Technical Education for the 21st Century Act." This legislation included the requirement to conduct a comprehensive local needs assessment, which must include input from community stakeholders. This project designed and evaluated a three-step process that…

Positive Behavioral Interventions and Supports (PBIS) is an evidence-based approach to addressing behavior issues in schools. A significant amount of research has been done to identify the critical features of PBIS. More generally, implementation science points to a specific sequence to ensure that PBIS is implemented with fidelity. This fall…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

This study develops an SDG-aligned social impact assessment (SIA) system for five Chulalongkorn University research projects, in Thailand. Employing mixed methods in an exploratory sequential design, the first phase involves qualitative data collection, including focus groups and field studies, to establish the SIA system. The second phase employs…

This paper explores using data mining in English teaching assessment in higher education within the 'Internet + Education' era. Traditional assessment methods struggle to meet modern teaching needs. By collecting diverse data like student performance and learning behavior, and employing data mining, a comprehensive assessment model is built. This…

In this chapter, we draw on the data collected during our evaluations of six TAACCCT grants to describe the challenges, successes, and transformative effect of adopting a developmental evaluation approach for community college programs.

These are the appendices for the report "The Effects of an Academic Language Program on Student Reading Outcomes." This study investigated WordGen Elementary, a program designed to improve fourth- and fifth-grade students' ability to understand and communicate academic language and their general reading skill. The program provider…

"Cases Integrating Ethnography and Evaluation" examines the connections between ethnography and evaluation in educational spaces, wrestling with pressing justice and equity issues in today's societies across the world. The book provides readers from different disciplines and practice areas with detailed accounts of evaluation and…

Educators working in museums, zoos, and botanic gardens are increasingly required to demonstrate impact. These requirements position 'performative evaluation' as the dominant model, one which also acts as a political, non-neutral, and managerial form of accountability. In contrast, 'practice evaluation' is intended to be democratic, dialogic, and…

A data party is an engaging way to involve stakeholders in program evaluation. We explain the use of a data party for engaging 4-H program stakeholders (e.g., staff and volunteers) in data interpretation and helping them understand, embrace, and use program evaluation information to make data-driven decisions about their programs. We present two…

Expanded learning intermediaries are nonprofit organizations dedicated to making after-school and summer programs better and more accessible for children and youth. They do this by coordinating efforts and resources in a given community, knitting programs together into a cohesive system, helping individual programs function at a high level, and…

The "Forum Guide to Data Literacy" is designed to help education agencies understand and build data literacy skills among various stakeholder groups such as administrators, teachers, students, parents and other caregivers, school board members, legislators, and community groups. This resource defines and discusses the importance of data…

In March 2020, the coronavirus pandemic and attending shift to remote schooling initiated a dramatic impact on student learning, an impact that state and district leaders feel a sense of urgency to understand and address. These leaders are accustomed using state and district test data to shed light on student achievement and growth. But without…

Novice programmers often struggle on assignments, and timely help, such as a hint on what to do next, can help students continue to progress and learn, rather than giving up. However, in large programming classrooms, it is hard for instructors to provide such real-time support for every student. Researchers have, therefore, put tremendous effort…