NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ761985
Record Type: Journal
Publication Date: 2007-May
Pages: 11
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0033-3085
EISSN: N/A
Available Date: N/A
Latent Trait Models for Assessing Multirater Multiattribute Agreement
Zhou, Zheng; Xin, Tao
Psychology in the Schools, v44 n5 p515-525 May 2007
The traditional kappa statistic in assessing interrater agreement is not adequate when multiraters and multiattributes are involved. In this article, latent trait models are proposed to assess the multirater multiattribute (MRMA) agreement. Data from the Third International Mathematics and Science Studies (TIMSS) are used to illustrate the application of the latent trait models. Results showed that among four possible latent trait models, the correlated uniqueness model had the best fit to assess the MRMA agreement. Furthermore, in coding a set of different attributes, the coding accuracy within the same rater may differ across attributes. Likewise, when different raters rate the same attribute, the accuracy in rating varies among the raters. Thus, the latent models provide us with a more refined and accurate assessment of interrater agreement. The application of the latent trait models is important in school psychology research and intervention because accurate assessment of children's functioning is fundamental in designing effective intervention strategies. (Contains 4 tables and 4 figures.)
John Wiley & Sons, Inc. Subscription Department, 111 River Street, Hoboken, NJ 07030-5774. Tel: 800-825-7550; Tel: 201-748-6645; Fax: 201-748-6021; e-mail: subinfo@wiley.com; Web site: http://www3.interscience.wiley.com.bibliotheek.ehb.be/browse/?type=JOURNAL
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: Researchers
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A