Formulae for Estimating Rater Reliability from the Significance of Treatment Effects.

Magee, Kevin N.; Overall, John E.

Notes FAQ Contact Us

Back to results

Peer reviewed

ERIC Number: EJ453809

Record Type: Journal

Publication Date: 1992

Pages: N/A

Abstractor: N/A

ISBN: N/A

ISSN: ISSN-0013-1644

EISSN: N/A

Available Date: N/A

Formulae for Estimating Rater Reliability from the Significance of Treatment Effects.

Magee, Kevin N.; Overall, John E.

Educational and Psychological Measurement, v52 n3 p545-48 Fall 1992

Formulae for estimating individual rater reliabilities from analysis of treatment effects are presented and evaluated. Monte Carlo methods illustrate the formulae. Results indicate that large sample sizes, large true treatment effects, and large differences in the actual reliabilities of raters are required for the approach to be useful. (SLD)

Descriptors: Effect Size, Estimation (Mathematics), Experimental Groups, Mathematical Formulas, Monte Carlo Methods, Rating Scales, Sample Size, Simulation, Statistical Significance

Publication Type: Journal Articles; Reports - Evaluative

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A

Author Affiliations: N/A