ERIC Number: EJ774673
Record Type: Journal
Publication Date: 2007
Pages: 19
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
Available Date: N/A
How to Meta-Analyze Coefficient-of-Stability Estimates: Some Recommendations Based on Monte Carlo Studies
Mason, Corinne; Allam, Reynald; Brannick, Michael T.
Educational and Psychological Measurement, v67 n5 p765-783 2007
Reliability generalization studies have provided estimates of the mean reliability coefficients and examined factors that explain the variability in the reliability estimates across studies for many different tests and measures. Different authors have used different data analyses to do such meta-analyses, and little research has addressed whether some methods are more accurate than others. Three methods of meta-analysis for reliability data were compared using Monte Carlo techniques. The meta-analytic methods were those described by Hedges and Vevea, Hunter and Schmidt, and Vacha-Haase. The results suggested that a combination of methods worked best and that Hunter and Schmidt's method should be used to estimate the mean and random-effect variance component, but weighted regression should be used to model continuous moderators. (Contains 1 table and 4 figures.)
Descriptors: Reliability, Monte Carlo Methods, Meta Analysis, Generalization, Comparative Analysis, Evaluation Methods
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A