The purpose of this article is to offer both theoretical and practical support to evaluation professionals preparing to facilitate the utilization phase of evaluation with a program or organization team. The Systems Evaluation Protocol for Participatory Data Use (SEPPDU) presented here is rooted in a partnership approach to evaluation and is…

This policy brief has been prepared by the Australian Council for Educational Research (ACER) for the UNESCO International Institute for Educational Planning (IIEP) Regional Conference, held in Manila from 5 to 7 November 2024. This brief is in response to the conference sub-theme of, 'Learning, equity and well-being: foundational literacy,…

Data is ubiquitous and inseparable from the human experience. It constantly informs and transforms interactions, decisions, and understanding. If the total amount of all the data created daily was printed on paper, it would fill a library the size of 110 Libraries of Congress. As a senior research consultant for an education market research and…

In the 2023 report "Colorado's Longitudinal Data Landscape. Report to the Education Committees of the Colorado House of Representatives and the Colorado Senate. Statute: 23-1-141," the Colorado Department of Higher Education (CDHE) provided a detailed overview of Colorado's long history of efforts to support more connected, longitudinal…

Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

Policymakers across the country are seeking to better understand credentials of value--the education and training programs that help workers fill in-demand and growing jobs in their states. But right now, leaders are lacking the complete set of information they need to understand P-20W (early childhood, K-12, postsecondary, and workforce) pathways…

While there are many different types of education data, policymakers and education leaders often place heavy emphasis on data from large-scale quantitative measures, such as annual state assessments. But data from these sources alone do not provide a complete picture of learning and are often not well suited to informing improvements at the local…

Data-based decision making (DBDM) is a process of using student data to inform instructional decisions and intensify intervention for students whose data indicate inadequate academic and behavioral progress. Data teams, an important structure for DBDM, are a collaborative group of school faculty who meet to systematically analyze student data,…

Only weeks into its new term, the Trump administration has taken steps to lay off federally funded education research staff, cancel nearly $1 billion in contracts and dismantle the U.S. Department of Education. These moves have upended evaluations of federally funded education programs and threatened access to massive data sets that states,…

Students cannot experience the full potential benefits of an intervention unless they are receiving the intervention. This is the second installment in a three-part series on intervention fidelity designed to highlight the importance of ensuring classroom supports are implemented as intended. This article provides guidance related to measuring and…

A national poll from the Data Quality Campaign (DQC), conducted by The Harris Poll, surveyed early childhood administrators--educational or child care professionals in program director or general manager roles serving children from birth through age four--to find out how they are collecting, using, and reporting data. Early childhood…

Growing awareness of reading difficulties such as dyslexia have prompted the rise of legislation requiring schools to screen all students for reading difficulties. Universal screening programs involve quick, regular assessments of specific reading-related skills so that educators can determine which students need support. Robin Irey and colleagues…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

Speculative reform jumps the gun on notions of data-driven reform, requiring administrators to anticipate and act to ensure problems (and the data that would show them) do not materialize. Speculative reforms are incapable of delivering the outcomes they promise, as they are fueled by a fear of the future that their reforms do not extinguish. In…

Educational games help reinforce educational concepts. They help students learn through hypothesizing, probing, and reflecting upon the game environment. Understanding the impact of a game is important before deploying it in a class. Recent studies in learning analysis describe methodologies and approaches for analyzing educational games. However,…