Randomized controlled trials have proliferated in education, in part because they provide an unbiased estimator for the causal impact of interventions. It is increasingly recognized that many such trials in education have low power to detect an effect if indeed there is one. However, it is less well known that low powered trials tend to…

Underrepresentation of historically marginalized populations in clinical trials continues to threaten the validity of health intervention research. Evidence supports the merits of intercept and other proactive forms of recruitment for achieving more equitable representation. However, researchers also report lower retention and adherence to…

Partnering with governments to co-design pilot interventions and embed them in local bureaucratic systems is increasingly seen as "best practice" on grounds of scalability and sustainability. This paper reports on a pilot program that was co-designed with, and embedded within, the Elementary and Secondary Education Department in…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

Recent reviews of the educational intervention literature have noted patterns of intervention impact fadeout on cognitive skills, whereby skill trajectories between children in the intervention and control group converge in the years following the end of the intervention. Some early childhood education (ECE) researchers have suggested that skill…

This study examined bias reduction in the eight nonequivalent comparison group designs (NECGDs) that result from combining (a) choice of a local versus non-local comparison group, and analytic use or not of (b) a pretest measure of the study outcome and (c) a rich set of other covariates. Bias was estimated as the difference in causal estimate…

Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

Traditionally, cluster randomized controlled trials are analyzed with the average intervention effect of interest. However, in populations that contain higher degrees of heterogeneity or variation may differ across different values of a covariate, which may not be optimal. Within education and social science contexts, exploring the variation in…

Parenting programs have been shown to be effective in preventing and reducing externalising problems in young children. Despite their efficacy, the low rate of initial parental engagement in these programs is a major challenge for clinicians and researchers. Few studies have examined factors associated with rates of initial engagement in parenting…

This article examines the implementation, participation rates, and potential determinants of participation in the digital addiction prevention program "ready4life." A two-arm cluster-randomized trial recruited German vocational students via class-based strategies. Intervention group received 16 weeks of in-app coaching; the control group…

Background: In children with a cleft palate with or without a cleft lip (CP±L), some evidence exists for superior results of high-intensity speech intervention (HISI) compared with low-intensity speech intervention (LISI) on speech and health-related quality of life (HRQoL). However, the existing research often involves small sample sizes.…

Background: This systematic review investigated the state of intervention science on programs that promote healthy intimate relationship skills and sexual health for autistic youth (i.e., healthy intimacy). Methods: Using PRISMA guidelines, we reviewed randomized controlled trials (RCTs) published in 2010 or later that enrolled [less than or equal…

Cluster randomized control trials often incorporate a longitudinal component where, for example, students are followed over time and student outcomes are measured repeatedly. Besides examining how intervention effects induce changes in outcomes, researchers are sometimes also interested in exploring whether intervention effects on outcomes are…

Noncompliance to treatment assignment is widespread in randomized trials and presents challenges in causal inference. In the presence of noncompliance, the most commonly estimated effect of treatment assignment, also known as the intent-to-treat (ITT) effect, is biased. Of interest in this setting is the complier average causal effect (CACE), the…