Noncompliance to treatment assignment is widespread in randomized trials and presents challenges in causal inference. In the presence of noncompliance, the most commonly estimated effect of treatment assignment, also known as the intent-to-treat (ITT) effect, is biased. Of interest in this setting is the complier average causal effect (CACE), the…

In paired experiments, participants are grouped into pairs with similar characteristics, and one observation from each pair is randomly assigned to treatment. The resulting treatment and control groups should be well-balanced; however, there may still be small chance imbalances. Building on work for completely randomized experiments, we propose a…

An emerging body of research suggests that incorporating randomization schemes in single-case research designs strengthens study internal validity and data evaluation. The purpose of this study was to test the utility and feasibility of a randomized alternating-treatment design in an investigation that compared the combined effects of vocabulary…

A solid understanding of fractions is the cornerstone for acquiring proficiency with rational numbers and paves the way for learning advanced mathematical concepts, such as algebra. Fraction difficulties limit not only students' educational and vocational opportunities but also their ability to solve everyday problems. Students who exit 6th grade…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Relevance interventions have shown a great potential to foster motivation and achievement (Lazowski & Hulleman, 2016). Yet, further research is warranted to test how such interventions can be successfully implemented in practice. We conducted a cluster-randomized trial in ninth-grade math classrooms to test the effectiveness of a relevance…

The purpose of this study was to examine the effects of MoBeGo, a mobile self-monitoring app, on the initial and sustained academic engagement and disruptive behavior of third- to eighth-grade students with challenging behavior. Student-teacher pairs (N = 57) were randomly assigned to the treatment (MoBeGo) or control (business-as-usual)…

Interventions often require multiple decisions to improve outcomes for every student. Whether the decision to implement a practice, tailor an existing protocol, or change approaches, these decisions should be based on individual variables and outcomes via a sequence of treatment. To develop adaptive interventions that have sufficient evidence to…

Introduction: Youth in disadvantaged urban areas are frequently exposed to chronic stress and trauma, including housing instability, neighborhood violence, and other poverty-related adversities. These exposures increase risk for emotional, behavioral, and academic problems and ultimately, school dropout. Schools are a promising setting in which to…

In this work, we describe a new statistical method to improve the detection of treatment effects in interventions. We call our method TAME (Trained Across Multiple Experiments). TAME takes advantage of multiple experiments with similar designs to create a single model. We use this model to predict the outcome of the dependent variable in unseen…

Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This…

We report the results of a preregistered, cluster randomized controlled trial of a mathematics learning intervention known as interleaved practice. Whereas most mathematics assignments consist of a block of problems devoted to the same skill or concept, an interleaved assignment is arranged so that no 2 consecutive problems require the same…

An impediment to conducting high-quality quantitative research studies in education is the paucity of valid measures of learning gains. Studies often seek to investigate students' deep, conceptual understanding yet many measures assess only surface, procedural understanding. One reason is that the development of validated measures of conceptual…

This study investigates the impact of an informal science outreach programme built around theories of identity formation and self-efficacy on middle school girls' science affinities. A lottery-based, randomised control trial was used to identify programme effects on four science affinity outcomes: science interests, efficacy with science, science…

Student-teacher relationships are important to student outcomes and may be especially pivotal at the high school transition and for minoritized racial/ethnic groups. Although interventions exist to improve student-teacher relationships, none have been shown to be effective among high school students or in narrowing racial/ethnic disparities in…