The purpose of this article is to offer both theoretical and practical support to evaluation professionals preparing to facilitate the utilization phase of evaluation with a program or organization team. The Systems Evaluation Protocol for Participatory Data Use (SEPPDU) presented here is rooted in a partnership approach to evaluation and is…

Data is ubiquitous and inseparable from the human experience. It constantly informs and transforms interactions, decisions, and understanding. If the total amount of all the data created daily was printed on paper, it would fill a library the size of 110 Libraries of Congress. As a senior research consultant for an education market research and…

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

Policymakers across the country are seeking to better understand credentials of value--the education and training programs that help workers fill in-demand and growing jobs in their states. But right now, leaders are lacking the complete set of information they need to understand P-20W (early childhood, K-12, postsecondary, and workforce) pathways…

Only weeks into its new term, the Trump administration has taken steps to lay off federally funded education research staff, cancel nearly $1 billion in contracts and dismantle the U.S. Department of Education. These moves have upended evaluations of federally funded education programs and threatened access to massive data sets that states,…

In the 2023 report "Colorado's Longitudinal Data Landscape. Report to the Education Committees of the Colorado House of Representatives and the Colorado Senate. Statute: 23-1-141," the Colorado Department of Higher Education (CDHE) provided a detailed overview of Colorado's long history of efforts to support more connected, longitudinal…

While there are many different types of education data, policymakers and education leaders often place heavy emphasis on data from large-scale quantitative measures, such as annual state assessments. But data from these sources alone do not provide a complete picture of learning and are often not well suited to informing improvements at the local…

Traditional functional budgets are useful for planning under predictable business environments. However, due to increased competition, changes in technology, consumer attitudes, and economic factors affecting supply chains, accountants must understand the characteristics of risk and uncertainty. Additionally, businesses now have access to…

Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

Students cannot experience the full potential benefits of an intervention unless they are receiving the intervention. This is the second installment in a three-part series on intervention fidelity designed to highlight the importance of ensuring classroom supports are implemented as intended. This article provides guidance related to measuring and…

A national poll from the Data Quality Campaign (DQC), conducted by The Harris Poll, surveyed early childhood administrators--educational or child care professionals in program director or general manager roles serving children from birth through age four--to find out how they are collecting, using, and reporting data. Early childhood…

Each year, state legislators introduce hundreds of bills that generate new data collections, analyses, and resources, playing a crucial role in how people access and use data. Notably, in 2023 legislators introduced and enacted bills governing cross-agency data systems--the most important step that states must take to make robust access to data…

In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

Speculative reform jumps the gun on notions of data-driven reform, requiring administrators to anticipate and act to ensure problems (and the data that would show them) do not materialize. Speculative reforms are incapable of delivering the outcomes they promise, as they are fueled by a fear of the future that their reforms do not extinguish. In…

Everyone who uses student information has a responsibility to maintain students' privacy and the security of their data. Ensuring student data privacy is about so much more than complying with the Family Educational Rights and Privacy Act (FERPA). While privacy must be top of mind when thinking about collecting and using personally identifiable…