ERIC Number: EJ1325789
Record Type: Journal
Publication Date: 2022-Feb
Pages: 38
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0049-1241
EISSN: N/A
Available Date: N/A
The Mechanics of Treatment-Effect Estimate Bias for Nonexperimental Data
Penaloza, Roberto V.; Berends, Mark
Sociological Methods & Research, v51 n1 p165-202 Feb 2022
To measure "treatment" effects, social science researchers typically rely on nonexperimental data. In education, school and teacher effects on students are often measured through value-added models (VAMs) that are not fully understood. We propose a framework that relates to the education production function in its most flexible form and connects with the basic VAMs without using untenable assumptions. We illustrate how, due to measurement error (ME), cross-group imbalances created by nonrandom group assignment cause correlations that drive the models' treatment-effect estimate bias. We derive formulas to calculate bias and rank the models and show that no model is better in all situations. The framework and formulas' workings are verified and illustrated via simulation. We also evaluate the performance of latent variable/errors-in-variables models that handle ME and study the role of extra covariates including lags of the outcome.
Descriptors: Data, Value Added Models, Error of Measurement, Correlation, Statistical Bias, Statistical Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A