Discussions of randomised controlled trials (RCTs) in education that do not show an impact regularly focus on the intervention and how it failed to impact on expected measures, with typologies identifying persistent critical points of failure. This paper uses one such RCT--the Integrating English programme--to exemplify the application of a new…

This article reviews the origins and use of the terms quasi-experiment and natural experiment. It demonstrates how the terms conflate whether variation in the independent variable of interest falls short of random with whether researchers find, rather than intervene to create, that variation. Using the lens of assignment--the process driving…

COVID-19 required many research teams to shift from in-person to remote assessments, which posed both procedural and theoretical challenges. While research has explored the utility of remote assessments for autism diagnosis from the perspective of families and clinicians, less is known about their application in clinical trials. This paper…

Though previously unacknowledged, a SMART (Sequential Multiple Assignment Randomized Trial) design uses both regression discontinuity (RD) and randomized controlled trial (RCT) designs. This combination structure creates a conceptual symbiosis between the two designs that enables both RCT- and previously unrecognized, RD-based inferential claims.…

This article provides an introduction to randomized response polling, a technique which was designed to allow for questioning on sensitive issues while protecting the respondent's privacy and avoiding social desirability bias. It is described in terms that are suitable for presentation and use in any classroom environment. Instructions for plain…

ICH-GCP guidelines have provided international ethical, scientific, quality standards for designing, conducting, recording, and reporting of clinical trials, and are hugely popular in the region. Recent revisions to its guidance; ICH-GCP; E6 (R3) have brought significant changes in both structure and content from its predecessor, affecting every…

In recent years, countries including the UK and USA have seen advancements in the use of Randomised Controlled Trials in education, progress that has not been mirrored in Ireland. Ireland does not have a strong tradition of using experimental or quasi-experimental evaluation designs for monitoring and evaluation of education policy despite…

Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and…

Increasing concerns about the trustworthiness of research have prompted calls to scrutinise studies' Individual Participant Data (IPD), but guidance on how to do this was lacking. To address this, we developed the IPD Integrity Tool to screen randomised controlled trials (RCTs) for integrity issues. Development of the tool involved a literature…

Group design studies in education include groups such as students, teachers, caregivers, schools, or districts assigned to conditions, typically treatment and control, to compare outcomes between the groups. Although the use of group designs in education has become more frequent and robust, the use of group designs in rural education lags far…

This paper summarises lessons learned from the Education Endowment Foundation's (EEF) early years (EY) trials and provides practical recommendations for conducting EY evaluations, particularly randomised control trials (RCTs) with pre-reception children. The report includes five sections, covering the following recommendations for the planning,…

Some patients benefit from a treatment while others may do so less or do not benefit at all. We have previously developed a two-stage network meta-regression prediction model that synthesized randomized trials and evaluates how treatment effects vary across patient characteristics. In this article, we extended this model to combine different…

Comprehensive evaluation of treatment effects is aided by considerations for moderated effects. In educational research, the combination of natural hierarchical structures and prevalence of group-administered or shared facilitator treatments often produces three-level partially nested data structures. Literature details planning strategies for a…

We describe an activity that introduces school-aged children to clinical trials, that presents the terminology associated with randomized controlled trials, and that reveals how the findings from clinical trials are applicable to everyone everywhere.

Partnering with governments to co-design pilot interventions and embed them in local bureaucratic systems is increasingly seen as "best practice" on grounds of scalability and sustainability. This paper reports on a pilot program that was co-designed with, and embedded within, the Elementary and Secondary Education Department in…