Conceptualizing Interrater Agreement as Testing the Existence of Extra Variation in the Multinomial Model.

Bartfay, Emma

Notes FAQ Contact Us

Back to results

Peer reviewed

ERIC Number: EJ678513

Record Type: Journal

Publication Date: 2003

Pages: N/A

Abstractor: N/A

ISBN: N/A

ISSN: ISSN-1530-5058

EISSN: N/A

Available Date: N/A

Conceptualizing Interrater Agreement as Testing the Existence of Extra Variation in the Multinomial Model.

Bartfay, Emma

International Journal of Testing, v3 n2 p151-61 2003

Used Monte Carlo simulation to compare the properties of a goodness-of-fit (GOF) procedure and a test statistic developed by E. Bartfay and A. Donner (2001) to the likelihood ratio test in assessing the existence of extra variation. Results show the GOF procedure possess satisfactory Type I error rate and power. (SLD)

Descriptors: Goodness of Fit, Interrater Reliability, Monte Carlo Methods, Simulation

Publication Type: Journal Articles; Reports - Research

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A

Author Affiliations: N/A