ERIC Number: ED532904
Record Type: Non-Journal
Publication Date: 2012
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1548-6613
EISSN: N/A
Available Date: N/A
IRR (Inter-Rater Reliability) of a COP (Classroom Observation Protocol)--A Critical Appraisal
Rui, Ning; Feldman, Jill M.
Online Submission, US-China Education Review B 3 p305-315 2012
Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers program. A combination of reliability measures (e.g., joint-probability of agreement, Cohen's kappa, polychoric correlation and intra-class correlation coefficients) was selected dependent upon which were appropriate given the scale of each item set. Results indicate that most items in physical environment, cognitive demand and students' class engagement can be assessed with moderate reliability. Items in classroom climate and instructional modes yielded mixed estimates. Recommendations were provided for possible improvement of similar instruments. (Contains 12 tables.)
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A