ERIC Number: ED606991
Record Type: Non-Journal
Publication Date: 2019
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1082-989X
EISSN: N/A
Available Date: N/A
Statistical Analyses for Studying Replication: Meta-Analytic Perspectives
Hedges, Larry V.; Schauer, Jacob M.
Grantee Submission, Psychological Methods v24 n5 p557-570 2019
Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have used different statistical approaches to determine if a finding has been replicated. The purpose of this article is to provide several alternative conceptual frameworks that lead to different statistical analyses to test hypotheses about replication. All of these analyses are based on statistical methods used in meta-analysis. The differences among the methods described involve whether the burden of proof is placed on replication or nonreplication, whether replication is exact or allows for a small amount of "negligible heterogeneity," and whether the studies observed are assumed to be fixed (constituting the entire body of relevant evidence) or are a sample from a universe of possibly relevant studies. The statistical power of each of these tests is computed and shown to be low in many cases, raising issues of the interpretability of tests for replication.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D140045; R305B140042
Author Affiliations: N/A