This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

Increased use of computer-based assessments has facilitated data collection processes that capture both response product data (i.e., correct and incorrect) and response process data (e.g., time-stamped action sequences). Evidence suggests a strong relationship between respondents' correct/incorrect responses and their problem-solving proficiency…

Colleges and universities are increasingly turning to algorithms that predict college-student success to inform various decisions, including those related to admissions, budgeting, and student-success interventions. Because predictive algorithms rely on historical data, they capture societal injustices, including racism. In this study, we examine…

Teachers' knowledge and skills about data-based instruction (DBI) can influence their self-efficacy and their implementation of DBI with fidelity, ultimately playing a crucial role in improving student outcomes. The purpose of this brief report is to provide evidence for the technical adequacy of a measure of DBI knowledge and skills in writing by…

Within the field of school psychology, we often put a premium on evidence-based practices, but what is often missing from these conversations is a consideration of replication and open science principles in the evaluation of evidence. Amid growing concerns regarding the replicability of psychological science, calls for greater research…

The use of data to inform instruction has been linked to improved student outcomes, early identification of intervention needs, and teacher decision-making and efficacy. Additionally, data are used as a means of accountability within educational settings. However, little is known about data use practices among early grades teachers. The purpose of…

The What Works Clearinghouse (WWC) at the Institute of Education Sciences reviews rigorous research on educational practices, policies, programs, and products with a goal of identifying 'what works' and making that information accessible to the public. One critique of the WWC is the need to more closely examine 'what works' for whom, in which…

States often turn to a data masking procedure called microsuppression in order to reduce the risk of disclosing student records when sharing data with external researchers. This process removes records deemed to have high risk for disclosure should data be released. However, this process can induce differences between the original data and the…

Although data-based individualization (DBI) has positive effects on learning outcomes for students with learning difficulties, this framework can be difficult for teachers to implement due to its complexity and contextual barriers. The first aim of this synthesis was to investigate the effects of ongoing professional development (PD) support for…

Racial and ethnic disproportionality in discipline (REDD) represents a longstanding and pervasive issue in the United States educational system. However, researchers and interventionists have not sufficiently provided educators with appropriate frameworks and feasible tools to disrupt REDD and promote equity. The goal of this paper is to present a…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

We explore institutional change and organizational learning in higher education in the context of a large-scale reform of developmental education in Florida. We use statewide survey data to examine administrators' perceptions of the use and effectiveness of accountability metrics, methods to identify solutions to improve student outcomes, and…

This article assesses the likely generalizability of educational treatment-effect estimates from regression discontinuity designs (RDDs) when treatment assignment is based on academic pretest scores. Our assessment uses data on outcome and pretest measures from six educational experiments, ranging from preschool through high school, to estimate…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…

The novel coronavirus disease 2019 (COVID-19) pandemic has created an unprecedented set of obstacles for schools and exacerbated existing structural inequalities in public education. In spring 2020, as schools went to remote learning formats or closed completely, end-of-year assessment programs ground to a halt. As a result, schools began the…