NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
ERIC Number: ED652191
Record Type: Non-Journal
Publication Date: 2024
Pages: 111
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Causal Inferences from Observational Studies in Education Policy: Towards Pragmatic Social Science
Kenneth A. Frank; Qinyun Lin; Spiro J. Maroulis
Grantee Submission
In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the general linear model, regression discontinuity designs, the propensity to be treated, and instrumental variables. Noting the advantages and limitations of each method, we turn to literature showing that conventional linear models, which can be extended to fixed and random effects models and difference-in-differences designs, are particularly useful when covariates include pre-tests. Recognizing that no technique fully resolves concerns about inferences, we quantify the conditions necessary to invalidate an inference. We review additional considerations including accounting for context, heterogeneous treatment effects, and mediation. Throughout we focus on the role of the researcher in making analytic choices, accentuated in the Quantcrit framework. [This chapter will be published in: "Handbook on Education Policy Research," edited by L. Cohen-Vogel et al., American Educational Research Association.]
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D220022
Author Affiliations: N/A