In educational contexts, students often self-select into specific interventions (e.g., courses, majors, extracurricular programming). When students self-select into an intervention, systematic group differences may impact the validity of inferences made regarding the effect of the intervention. Propensity score methods are commonly used to reduce…

Reporting standards and critical appraisal tools serve as beacons for researchers, reviewers, and research consumers. Parallel to existing guidelines for researchers to report and evaluate group-comparison studies, single-case experimental (SCE) researchers are in need of guidelines for reporting and evaluating SCE studies. A systematic search was…

The goal of this research is to make sensitivity analysis accessible not only to empirical researchers but also to the various stakeholders for whom educational evaluations are conducted. To do this it derives anchors for the omitted variable (OV)-program participation association intrinsically, using the Love plot to present a wide range of…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

Children (10 or 11 years old) with and without developmental coordination disorder (DCD) were exposed to imposed optic flow in a moving room. We manipulated the amplitude and frequency of oscillatory room motion, and we evaluated the coupling of standing body sway with room oscillations. The results revealed that standing sway of both children…

Teacher and principal surveys are among the most common data collection techniques employed in education research. Yet there is remarkably little research on survey methods in education, or about the most cost-effective way to raise response rates among teachers and principals. In an effort to explore various methods for increasing survey response…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

This work assessed the efficacy of a middle-school-based mentoring program designed to increase student use of self-regulated learning (SRL) strategies, self-efficacy for and the perceived usefulness of SRL as well as mathematics and language achievement. A longitudinal cluster randomized trial study design obtained evidence that found…

Randomized trials have experienced a marked surge in endorsement and popularity in education research in the past decade. This surge reignited paradigm debates and spurred qualitative critics to accuse these experimental designs of eclipsing qualitative research. This article reviews a current iteration of this debate and examines two randomized…

The purpose of this mixed-methods study is to compare the perceived benefits of topical Scripture memorization (TSM) with the perceived benefits of extended Scripture memorization (ESM) to explore if one strategy fosters more perceived spiritual growth than the other. A baseline for the study is established by investigating the historical,…

The potential for music programs to promote psychosocial wellbeing in mainstream schools is recognised in both policy and research literature. Despite this recognition, there is a dearth of consistent research evidence supporting this link. Authors attribute this lack of consistent evidence to limitations in the areas of research design and…

Objective: The current study tests electroencephalogram (EEG) measures as a potential endophenotype for attention deficit/hyperactivity disorder (ADHD) by examining sibling and parent-offspring similarity, familial clustering with the disorder, and association with the dopamine receptor D4 (DRD4) candidate gene. Method: The sample consists of 531…

This paper addresses methodological issues arising from an experimental study of North Carolina's Early College High School Initiative, a four-year longitudinal experimental study funded by Institute for Education Sciences. North Carolina implemented the Early College High School (ECHS) Initiative in response to low high school graduation rates.…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…