ERIC Number: ED671462
Record Type: Non-Journal
Publication Date: 2021-Jan
Pages: 29
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Improving Average Treatment Effect Estimates in Small-Scale Randomized Controlled Trials. EdWorkingPaper No. 20-344
Isaac M. Opper
Annenberg Institute for School Reform at Brown University
Researchers often include covariates when they analyze the results of randomized controlled trials (RCTs), valuing the increased precision of the estimates over the potential of inducing small-sample bias when doing so. In this paper, we develop a sufficient condition which ensures that the inclusion of covariates does not cause small-sample bias in the effect estimates. Using this result as a building block, we develop a novel approach that uses machine learning techniques to reduce the variance of the average treatment effect estimates while guaranteeing that the effect estimates remain unbiased. The framework also highlights how researchers can use data from outside the study sample to improve the precision of the treatment effect estimate by using the auxiliary data to better model the relationship between the covariates and the outcomes. We conclude with a simulation, which highlights the value of using the proposed approach.
Descriptors: Randomized Controlled Trials, Sample Size, Statistical Bias, Artificial Intelligence, Computer Software, Accuracy, Evaluation Methods, Simulation, Causal Models, Mathematics Achievement, Student Improvement, Scores, Attendance, Dropout Prevention, Outcome Measures
Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Annenberg Institute for School Reform at Brown University
Identifiers - Location: New York (New York)
Grant or Contract Numbers: N/A
Author Affiliations: N/A