This study investigates the effect of survey order in measuring self-reported cognitive load. Understanding how survey order influences responses is crucial, but it has been largely overlooked in the context of cognitive load. Using a 2 × 2 experimental design with 319 high school students, the study manipulated intrinsic cognitive load (ICL)…

This paper introduces a simple, quotient effect size, termed (for 'quotient'), suitable for reporting on the effectiveness of educational interventions. The quotient effect size for a pre-test-post-test design is defined as the gain score (i.e. post-test minus pre-test) for the intervention group, divided by the gain score for the control group.…

Background: Evidence from education randomized controlled trials (RCTs) in low- and middle-income countries (LMICs) demonstrates how interventions can improve children's educational achievement [1, 2, 3, 4]. RCTs assess the impact of an intervention by comparing outcomes--aggregate test scores--between treatment and control groups. A review of…

Researchers use test outcomes to evaluate the effectiveness of education interventions across numerous randomized controlled trials (RCTs). Aggregate test data--for example, simple measures like the sum of correct responses--are compared across treatment and control groups to determine whether an intervention has had a positive impact on student…

When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

Sulforaphane has been reported to possibly improve core symptoms associated with autism spectrum disorders from mostly small size studies. Here we present results of a larger randomized clinical trial (N = 108) in China. There were no significant changes in caregiver rated scales between sulforaphane and placebo groups. However, clinician rated…

Parenting programs have been shown to be effective in preventing and reducing externalising problems in young children. Despite their efficacy, the low rate of initial parental engagement in these programs is a major challenge for clinicians and researchers. Few studies have examined factors associated with rates of initial engagement in parenting…

Anatomy is an important component in the vertical integration of basic science and clinical practice. Two common pedagogies are cadaveric dissection and examination of prosected specimens. Comparative studies mostly evaluate their immediate effectiveness. A randomized controlled trial design was employed to compare both the immediate and long-term…

Identifying effective methods that can counteract seasonal trends in learning loss is essential to ensure continuous literacy growth of young learners. Computer-assisted instruction (CAI) is a solution for providing an effective summer literacy program that could help offset summer learning loss. In this study, four-year-old students from South…

It is not uncommon for randomised trials in education to have the performance of sample members in national examinations as their primary outcome. In many cases, examination results are available as summary measures only. Taking the example of GCSE examination results in England, this paper shows that using summary measures of an underlying score…

In a randomized controlled trial (RCT), some subjects assigned to the treatment condition may not fully comply. Often there is interest in the effect of the treatment within the "principal stratum" of subjects who would comply if assigned to treatment. However, it is unknown which control subjects would have complied if treated and which…

Binocular disparity provides one of the important depth cues within stereoscopic three-dimensional (3D) visualization technology. However, there is limited research on its effect on learning within a 3D augmented reality (AR) environment. This study evaluated the effect of binocular disparity on the acquisition of anatomical knowledge and…

The purpose of the current study was to examine the dosage and fidelity of EMT en Español strategies that are posited to drive change in child outcomes. The study is a re-analysis of data collected during the National Institutes of Health (NIH) R21 grant "Teaching Spanish-speaking Caregivers to Implement EMT en Español: A Small Randomized…

Even when raters demonstrate agreement in the use of a measure, limited score variability or violation of often-ignored statistical assumptions can result in lower reliability estimates than intuitively expected. This article uses data drawn from two randomized controlled trials of schema therapy and cognitive behavioral therapy for the treatment…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…