NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: ED609748
Record Type: Non-Journal
Publication Date: 2017-Apr-30
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-
EISSN: N/A
Available Date: N/A
Small-Sample Methods for Heteroscedasticity-Robust Hypothesis Tests in Linear Regression: A Review and Evaluation
Pustejovsky, James Eric; Furman, Gleb
AERA Online Paper Repository, Paper presented at the Annual Meeting of the American Educational Research Association (San Antonio, TX, Apr 27-May 1, 2017)
In linear regression models estimated by ordinary least squares, it is often desirable to use hypothesis tests and confidence intervals that remain valid in the presence of heteroskedastic errors. Wald tests based on heteroskedasticity-consistent covariance matrix estimators (HCCMEs, also known as sandwich estimators or simply "robust" standard errors) are a well known and widely applied method that remains asymptotically valid under heteroskedasticity of an unspecified form. Wald-type t-tests based on HCCMEs maintain nominal rejection rates when the sample size is large, but they are not always accurate with small samples; moreover, it can be difficult to determine whether a given sample is large enough to trust the asymptotic approximation. This paper reviews several approaches to approximating the null sampling distribution of HCCME t-tests and thereby improving the accuracy of rejection rates in small samples. Using simulations, we investigate the relative performance of Satterthwaite, Edgeworth, and saddlepoint approximations under a wide range of data generating processes. Results indicate that certain distributional approximations perform similarly to conventional tests based on HCCMEs, and can improve upon them when the nominal Type-I error rate is less than 0.05.
AERA Online Paper Repository. Available from: American Educational Research Association. 1430 K Street NW Suite 1200, Washington, DC 20005. Tel: 202-238-3200; Fax: 202-238-3250; e-mail: subscriptions@aera.net; Web site: http://www.aera.net
Publication Type: Speeches/Meeting Papers; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A