Caregivers (N=53) of dementia patients administered modified version of cognitive examination at home to their patients. Comparison between caregiver-administered and clinical examinations revealed high interrater reliability unaffected by caregiver age or education level. Reliable assessment of cognitive functioning by caregivers can provide…

Investigates the marker-marker reliability of an examination for a third-year degree course in circuit theory. Reports that the coefficient of correlation between markers fell within the range 0.94 to 0.98. (YP)

A method is presented for determining sample size that will achieve a pre-specified bound on confidence interval width for the interrater agreement measure "kappa." The same results can be used when a pre-specified power is desired for testing hypotheses about the value of kappa. (Author/SLD)

Reviews "Written Language Assessment" (WLA), a new standardized test to evaluate children's and adolescents' written language competence by having students write essays instead of answer multiple choice questions. Finds problems with the WLA in terms of interrater reliability. (RS)

This study, involving five college students observing behavior of individuals with mental retardation, found that interobserver agreement was better in the presence of certain stimuli (such as when the subject's peers were present versus when they were not). Of 10 additional variables thought to potentially affect agreement scores, 1 (can't see,…

This literature review examined the congruence between parental estimates and professionals' assessments of the abilities of children with disabilities. Results suggest that there are strong, positive correlations between parental and professional judgments, and that methodology relates to the degree of congruence between parental and professional…

This study examined the comparability and predictive validity of three approaches to measurement of child or adolescent maltreatment, involving the adolescents themselves (n=160), case file review by researchers, and protection agency social workers. Comparison of ratings across sources indicated considerable disagreement with respect to judgments…

Observers and mothers rated infant behavior in the home on dimensions of temperament once a week for eight weeks. Although week-to-week correlations were modest, aggregates of the eight observations had high reliability for both observers and mothers. When direct observations were compared with mother reports, little evidence of mother-observer…

Mothers, teachers, and assistant teachers completed two measures of child behavior when children born prematurely were two and three years old. Interinstrument correlations for total scores, and the stability of the Behavior Check List from two to three years, were moderate. Interrater agreements between teachers and assistant teachers were…

Analysis of reliability among peer reviews of 422 unsolicited articles for the "Journal of Clinical Anesthesia" found that most articles' reviews were consistent or near consistent. However, articles reviewed by two of the editorial board members were much less likely to be accepted than those read by two nonmembers. (Author/MSE)

Sixty-one examiners provided a rating of whether a significant change in performance of handicapped individuals occurred across the baseline and treatment phases of six graphs of hypothetical data from single-subject designs. Results revealed considerable interrater disagreement on four graphs, especially those involving change in variability or…

Unsophisticated raters judged speech naturalness and stuttering severity in audio-only and audiovisual presentations of speech samples. For stutterer samples, raters judged the audiovisual presentation more unnatural than the audio presentation, but for the nonstutterer samples, there was no difference. Stuttering severity ratings did not differ…

Comparison of self- and others' ratings of 335 managers' job performance found moderately low agreement between the two. Managers consistently reported practicing specific skills more frequently than raters' feedback showed, across 20 management practices areas. (SK)

Examined the validity of the Adult Attachment Interview (AAI) measure by interviewing 83 mothers twice over 2 months, using different interviewers on each occasion. The results indicated that the reliability of the AAI classifications was quite high over time and across interviewers. The AAI classifications were independent of nonattachment…

This article presents arguments that the correlation measure "r" of halo is not conceptually more appropriate than the standard deviation (SD) measure. It also describes conditions under which halo effects occur and when the SD and r measures can be used. Neither measure is uniformly superior to the other. (SLD)