A study evaluated and compared four methods of assessing reliability on one discourse analysis procedure--a modified version of Damico's Clinical Discourse Analysis. The methods were Pearson product-moment correlations; interobserver agreement; Cohen's kappa; and generalizability coefficients. The strengths and weaknesses of the methods are…

Preselected colposcopic photographs of the anogenital area of 16 patients were shown to 170 medical examiners, who rated their level of suggestion or indication of penetrating injury. Agreement between the participants and experts was higher on the abnormal cases than on the normal cases, and higher on genital findings than on anal findings.…

Eighteen adolescents and adults with severe/profound intellectual disability were rated by two staff members using the Motivation Assessment Scale to identify variables maintaining their aggressive behaviors. Analysis of interrater reliability indicated that for some individuals the scale may not represent a feasible alternative to more formal…

Four studies investigated reliability and validity of the Theory of Mind (TOM) test, an instrument for assessing theory-of-mind ability in typical children and children with pervasive developmental disorders. The TOM test was found to be a reliable and valid instrument for measuring various aspects of theory of mind. (Author/CR)

Three studies are reported addressing the reliability of the Scale for Assessing Emotional Disturbance (SAED), a standardized, norm-reference measure linked to the federal definition of emotional disturbance (ED). Results indicate the SAED possesses acceptable test-retest reliability and reasonable interrater reliability and can assist in the…

The development of the Asperger Syndrome (and high-functioning autism) Diagnostic Interview (ASDI) is described. Preliminary data from a clinical study of 20 individuals (ages 6-55) suggest that interrater reliability and test-retest stability may be excellent, with kappas exceeding 0.90 in both instances. The validity appears to be relatively…

Reliability analysis of the Motivation Assessment Scale was conducted on subscales completed by staff members working with 47 institutionalized adults with severe to profound mental retardation and self-injurious behavior problems. Internal consistency was found to be superior to interrater reliability. The instrument's internal consistency…

The Test of Spoken English (TSE) is an internationally administered instrument for assessing nonnative speakers' proficiency in speaking English. The research foundation of the TSE examination described in its manual refers to two sources of variation other than the achievement being measured: interrater reliability and internal consistency.…

This annotated bibliography was developed upon noting a deficiency of information in the literature regarding the training of raters for establishing agreement. The ERIC descriptor, "Interrater Reliability", was used to locate journal articles. Some of the 33 resulting articles focus on mathematical concepts and present formulas for computing…

Used the intraclass correlation coefficient to estimate the interrater reliability of judgments of clinician and novice raters of depressed females (N=20) who took the Hamilton Rating Scale for Depression (HRSD). Expert and student raters both made reliable ratings on the HRSD. Criterion validity for student raters was also satisfactory.…

A study of 71 students (ages 7-17) with disabilities investigated the interrater agreement of the Adjustment Scales for Children and Adolescents (ASCA), a behavior rating scale used in school settings. Participants were rated by 29 educational professionals in 24 classrooms. Results found ASCA produced acceptable levels of interrater agreement.…

Twenty rehabilitation patients were assessed on their activities of daily living using the Barthel Index, and were also observed by two occupational therapists in a simulated home unit. Results indicated good inter-observer reliability, and good agreement between asking the patient and professional observation of the patient. (JDD)

Sixty-five pairs of teachers and parents of elementary and secondary school learning-disabled students completed the Homework Problem Checklist (HPC). The HPC demonstrated a moderate level of interrater reliability. Acceptable levels of internal consistency were reported for both teacher and parent ratings. (JDD)

Tested the assumption that familial self-reports are biased by social desirability and other factors, through the use of a latent variables modeling approach that evaluated rater reliability and bias in mother, father, and child ratings of parent-child negativity. Results based on 78 families demonstrated that family member ratings contained a…

A study involving 200 adults with mental retardation investigated the interrater reliability and internal consistency of the Matson Evaluation of Drug Side Effects (MEDS), a scale designed to evaluate commonly identified side effects with a psychometrically sound checklist. The MEDS had excellent consistency across raters and good internal…