NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1327989
Record Type: Journal
Publication Date: 2022
Pages: 38
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1934-5747
EISSN: N/A
Available Date: N/A
The Sensitivity of Small Area Estimates under Propensity Score Subclassification for Generalization
Journal of Research on Educational Effectiveness, v15 n1 p178-215 2022
Over the past decade, statisticians have developed methods to improve generalizations from nonrandom samples using propensity score methods. While these methods contribute to generalization research, their effectiveness is limited by small sample sizes. Small area estimation is a class of model-based methods that address the imprecision due to small samples and prior research has shown its potential to improve precision in generalization studies with small samples. However, the validity of both small area methods and existing design-based methods depend on the assumptions of propensity score models, leaving open the question of whether a specific method is preferred when core assumptions are violated. This study compares the performance of design-based and model-based estimators of population parameters in generalization studies when the assumptions for propensity score models are violated. Using a simulation study and an empirical example, we assess the sensitivity of the estimators under various degrees of violations in assumptions, discuss the advantages and tradeoffs of each approach, and highlight the implications for generalization research.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A