The Test of Spoken English (TSE) is an internationally administered instrument for assessing nonnative speakers' proficiency in speaking English. The research foundation of the TSE examination described in its manual refers to two sources of variation other than the achievement being measured: interrater reliability and internal consistency.…

This annotated bibliography was developed upon noting a deficiency of information in the literature regarding the training of raters for establishing agreement. The ERIC descriptor, "Interrater Reliability", was used to locate journal articles. Some of the 33 resulting articles focus on mathematical concepts and present formulas for computing…

A distinction is made between reliability of measurement and reliability of classification; the "criterion-referenced reliability coefficient" describes the former. Application of this coefficient to the probability distribution of possible scores for a single student yields a meaningful way to describe the reliability of a single score. (Author)

Two five-week test-retest reliability studies of a measure of the unit of perception of ongoing behavior were conducted. In the first, 25 females and 23 males segmented a 7-minute action sequence under fine-unit or gross-unit instructional sets. Number of units marked at first viewing correlated .87 with number of units at retest. Correlations…

Used the intraclass correlation coefficient to estimate the interrater reliability of judgments of clinician and novice raters of depressed females (N=20) who took the Hamilton Rating Scale for Depression (HRSD). Expert and student raters both made reliable ratings on the HRSD. Criterion validity for student raters was also satisfactory.…

A study of 71 students (ages 7-17) with disabilities investigated the interrater agreement of the Adjustment Scales for Children and Adolescents (ASCA), a behavior rating scale used in school settings. Participants were rated by 29 educational professionals in 24 classrooms. Results found ASCA produced acceptable levels of interrater agreement.…

Offers practitioners and researchers an overview of two inventories used in the study of antisocial and delinquent behavior. Evidence suggests that the inventories are related to behavioral indices associated with antisocial and delinquent behavior. Concludes that both instruments are robust and can yield valuable results. (RJM)

Twenty rehabilitation patients were assessed on their activities of daily living using the Barthel Index, and were also observed by two occupational therapists in a simulated home unit. Results indicated good inter-observer reliability, and good agreement between asking the patient and professional observation of the patient. (JDD)

Sixty-five pairs of teachers and parents of elementary and secondary school learning-disabled students completed the Homework Problem Checklist (HPC). The HPC demonstrated a moderate level of interrater reliability. Acceptable levels of internal consistency were reported for both teacher and parent ratings. (JDD)

A study involving 200 adults with mental retardation investigated the interrater reliability and internal consistency of the Matson Evaluation of Drug Side Effects (MEDS), a scale designed to evaluate commonly identified side effects with a psychometrically sound checklist. The MEDS had excellent consistency across raters and good internal…

Responds to a critique by Mudford, Hogg, and Roberts (1997) that raised concerns about the observation code used in a longitudinal research project to assess emerging behavior state patterns in young children with disabilities. Concerns about the thoroughness of the reliability data collected by Mudford are discussed. (Author/CR)

Forty neuropsychologists, neurologists, psychiatrists, and physiatrists identified neurologically relevant items (NRIs) in the Minnesota Multiphasic Personality Inventory-2 (MMPI-2). Raters identified four sets of NRIs: one for brain damage in general and three partially overlapping sets for stroke, traumatic brain damage, and whiplash.…

The utility of the Test for Severe Impairment was studied with 60 older persons who had Down Syndrome. Construct validity, test-retest reliability, and interrater reliability were established for the full study group and for subgroups based on degree of mental retardation and dementia status. Some possible applications and limitations of the test…

Presents data from the development and testing of an instrument created to evaluate the oral health of nursing home residents by nursing personnel. Examination of 100 residents by dentists and 3 categories of trained nurses established statistically significant interrater reliability, suggesting that nursing staff can be taught to evaluate the…

A study tested the psychometric properties of the Stereotyped Behavior Scale, an empirically developed behavior rating scale for adolescents and adults with mental retardation. Forty-five adults with mental retardation and various rates of stereotypies participated. Results found the scale had high rates of reliability, validity, and interrater…