NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ737243
Record Type: Journal
Publication Date: 2005
Pages: 27
Abstractor: Author
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: N/A
Available Date: N/A
On the Post Hoc Power in Testing Mean Differences
Yuan, Ke-Hai; Maxwell, Scott
Journal of Educational and Behavioral Statistics, v30 n2 p141-167 Sum 2005
Retrospective or post hoc power analysis is recommended by reviewers and editors of many journals. Little literature has been found that gave a serious study of the post hoc power. When the sample size is large, the observed effect size is a good estimator of the true power. This article studies whether such a power estimator provides valuable information about the true power. Using analytical, numerical, and Monte Carlo approaches, our results show that the estimated power does not provide useful information when the true power is small. It is almost always a biased estimator of the true power. The bias can be negative or positive. Large sample size alone does not guarantee the post hoc power to be a good estimator of the true power. Actually, when the population variance is known, the cumulative distribution function of the post hoc power is solely a function of the population power. This distribution is uniform when the true power equals 0.5 and highly skewed when the true power is near 0 or 1. When the population variance is unknown, the post hoc power behaves essentially the same as when the variance is known. (Contains 1 table and 5 figures.)
American Educational Research Association. 1230 17th St. NW, Washington, DC 20036-3078. Tel: 202-223-9485; Fax: 202-775-1824; e-mail: subscriptions@aera.net; Web site: http://www.aera.net.
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A