Methods of probability modeling to analyze rater agreement are described, emphasizing their basic similarities and viewing them as variants of a common methodology. Statistical techniques for analyzing agreement data are described to address questions such as how many opinions are required to make a medical diagnosis with necessary accuracy. Kappa…

The study reported in this paper builds upon earlier research designed to examine issues associated with initiating an effective teacher evaluation effort and integrating it into district practices. The paper describes four districts which have made substantial progress in initiating and organizing teacher evaluation programs and presents the view…