Even when raters demonstrate agreement in the use of a measure, limited score variability or violation of often-ignored statistical assumptions can result in lower reliability estimates than intuitively expected. This article uses data drawn from two randomized controlled trials of schema therapy and cognitive behavioral therapy for the treatment…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…

This paper describes a 12-week cluster randomized controlled trial that examined the efficacy of BookNook, a virtual tutoring platform focused on reading. Cohorts of first- through fourth-grade students attending six Rocketship public charter schools in Northern California were randomly assigned within grades to receive BookNook. Intent-to-Treat…

Objective: Our study aimed to compare the efficacy of artificial intelligence (AI)-based immersive training with human-led workshops to improve the English language skills of non-English early career researchers (NEECRs) in a Nigerian public university. Methods: Our study employed a randomized pretest/posttest control group design. A total of 124…

This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

The aim of this study was to investigate and empirically derive parameters commonly used for statistical power and sample size calculations to better inform future trial design. Towards achieving this aim, the research project leveraged the richness of the National Pupil Database (NPD) and the Education Endowment Foundation (EEF) Archive to: (1)…

Background: While implementation studies in aphasia management have shown promising improvements to clinical practice, it is currently unknown if aphasia implementation outcomes are sustained and what factors may influence clinical sustainability. Aims: To evaluate the sustainment (i.e., sustained improvement of aphasia management practices and…

Scores derived from intelligence instruments predict many important outcomes in life, so it is not surprising that researchers and clinicians seek out interventions aimed at increasing these scores. Dixon et al. (J Behav Educ, 2019. https://doi-org.bibliotheek.ehb.be/10.1007/s10864-019-09344-7) recently investigated the relation between instruction based on…

General and long-term outcomes of functional analysis training have not yet been reported. Within a randomized control trial, we trained 18 behavior analytic practitioners to interview caregivers, design and then conduct a personalized analysis as a part of a practical functional assessment (PFA). Participants were randomly assigned to groups, and…

The present study examined the content of applied behavior analytic therapy (ABA therapy) on skill acquisition and intelligence test scores of twenty-eight children with autism and related disabilities. Using a randomized controlled trial, we compared (a) traditional ABA consisting of verbal behavior techniques developed by Skinner (Verbal…

A solid understanding of fractions is the cornerstone for acquiring proficiency with rational numbers and paves the way for learning advanced mathematical concepts, such as algebra. Fraction difficulties limit not only students' educational and vocational opportunities but also their ability to solve everyday problems. Students who exit 6th grade…

Aim: To describe the development of an intervention-specific fidelity measure and its utilization and to determine whether the newly developed Sitting Together and Reaching to Play (START-Play) intervention was implemented as intended. Also, to quantify differences between START-Play and usual early intervention (uEI) services. Method: A fidelity…

Researchers often include covariates when they analyze the results of randomized controlled trials (RCTs), valuing the increased precision of the estimates over the potential of inducing small-sample bias when doing so. In this paper, we develop a sufficient condition which ensures that the inclusion of covariates does not cause small-sample bias…

This article summarizes findings from a two-year randomized control trial, focusing on a subset of 194 fourth graders with reading comprehension scores at or below the 15th percentile. Students in the treatment condition received an average of 94 daily 30-min sessions of small group intervention implemented with fidelity by well-trained research…

We consider situations in which public charter school lotteries are neither universally conducted nor consistently documented. Such lotteries produce "broken" Randomized Control Trials, but provide opportunities to assess the internal validity of quasi-experimental research designs. Here, we present the results of a statewide charter…