NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED670853
Record Type: Non-Journal
Publication Date: 2018-Jul
Pages: 52
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Decomposing Treatment Effect Variation
Peng Ding1; Avi Feller1; Luke Miratrix2
Grantee Submission
Understanding and characterizing treatment effect variation in randomized experiments has become essential for going beyond the "black box" of the average treatment effect. Nonetheless, traditional statistical approaches often ignore or assume away such variation. In the context of randomized experiments, this paper proposes a framework for decomposing overall treatment effect variation into a systematic component explained by observed covariates and a remaining idiosyncratic component. Our framework is fully randomization-based, with estimates of treatment effect variation that are entirely justified by the randomization itself. Our framework can also account for noncompliance, which is an important practical complication. We make several contributions. First, we show that randomization-based estimates of systematic variation are very similar in form to estimates from fully-interacted linear regression and two stage least squares. Second, we use these estimators to develop an omnibus test for systematic treatment effect variation, both with and without noncompliance. Third, we propose an R squared-like measure of treatment effect variation explained by covariates and, when applicable, noncompliance. Finally, we assess these methods via simulation studies and apply them to the Head Start Impact Study, a large-scale randomized experiment. [This paper was published in "Journal of the American Statistical Association" v114 n525 p304-317 2018.]
Publication Type: Reports - Research
Education Level: Early Childhood Education; Preschool Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Spencer Foundation
Authoring Institution: N/A
Identifiers - Laws, Policies, & Programs: Head Start
Identifiers - Assessments and Surveys: Peabody Picture Vocabulary Test
IES Funded: Yes
Grant or Contract Numbers: R305D150040
Department of Education Funded: Yes
Author Affiliations: 1UC Berkeley; 2Harvard GSE