The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…

Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

In this work, we describe a new statistical method to improve the detection of treatment effects in interventions. We call our method TAME (Trained Across Multiple Experiments). TAME takes advantage of multiple experiments with similar designs to create a single model. We use this model to predict the outcome of the dependent variable in unseen…

For the past 25 years, I have led multiple group-randomized trials, each focused on a specific underserved population of youth and each one evaluated health effects of complex interventions designed to prevent high-risk behaviors. I share my reflections on issues of intervention and research design, as well as how research results fostered my…

Purpose: This systematic survey evaluates the completeness of reporting in pilot and feasibility randomized controlled trials investigating behavioral interventions based on the Consolidated Standards of Reporting Trials (CONSORT) extension for pilot trials. Methods: The authors searched Medline/Pubmed and randomly selected 100 articles from 2012…

In this study we evaluated a social skills group which employed a progressive applied behavior analysis model for individuals diagnosed with autism spectrum disorder. A randomized control trial was utilized; eight participants were randomly assigned to a treatment group and seven participants were randomly assigned to a waitlist control group. The…

Personalized learning considers that the causal effects of a studied learning intervention may differ for the individual student. Making the inference about causal effects of studies interventions is a central problem. In this paper we propose the Residual Counterfactual Networks (RCN) for answering counterfactual inference questions, such as…

Objective: There is substantial evidence that poorly designed and reported research can mislead decision making in clinical care. This review investigates the methodological quality of Swedish trials of a wide array of psychological and social interventions. Method: The review includes 302 articles published in peer-reviewed journals during…

A habitually active environment is a feature of past times, and in stark contrast with that experienced by our children today. Consequently, twenty-first century physical education (PE) assumes a position of great responsibility. This is especially true in primary schools; a premise recently strongly supported by published evidence from the…

A variety of computerized interactive learning platforms exist. Most include instructional supports in the form of problem sets. Feedback to users ranges from a single word like "Correct!" to offers of hints and partially- to fully-worked examples. Behind-the-scenes design of systems varies as well--from static dictionaries of problems…

Recent studies [10, 23] using US nationwide databases showed high school boys spent significantly less time doing homework than girls, based on their responses to questionnaires and surveys. To investigate gender differences in homework in middle school, in this paper, we analyzed computer log data and standardized test scores of more than 1,000…

Purpose: This randomized controlled trial compared the efficacy between the Social Enterprise Intervention (SEI) and Individual Placement and Support (IPS) with homeless youth with mental illness to assess their impact on nonvocational outcomes. Method: Seventy-two homeless youth were recruited from one agency and randomized to the SEI (n = 36) or…