While well-established attachment measures have been developed for infancy, early childhood, and adulthood, a "measurement gap" has been identified in middle childhood, where behavioral or representational measures are not yet sufficiently robust. This article documents the development of a new measure--the Child Attachment Interview…

Previous efforts to investigate the equivalence of rating sources for job analysis ratings have reported conflicting results. In the present research, correlational and generalizability analyses were conducted to examine the equivalency of rating sources for over 70 state civil service job classifications. Incumbent and supervisor ratings (N=697)…

The effect of different types of rating task instructions on rater behavior was examined using experts, as opposed to novices, as raters. The experts were instructed to (1) form a global categorical judgment (early hypothesis generation); (2) assess 19 detailed elements; or (3) both. Subjects were 8 dental faculty members who ranged in age from 28…

Investigated Neuro-Linguistic Programming eye movement model's claim that specific eye movements are indicative of specific sensory components in thought. Agreement between students' (N=48) self-reports and trained observers' records support visual and auditory portions of model; do not support kinesthetic portion. Interrater agreement supports…

The use of U-statistics based on rank correlation coefficients in estimating the strength of concordance among a group of rankers is examined for cases where the null hypothesis of random rankings is not tenable. (Author/BW)

The difficulties in assessing teacher quality due to personal perceptions and attitudes is illustrated in a study of primary school headteachers. Findings indicate that such diversity in views leads to inability to define evaluation criteria. (Author/DF)

The purpose of this study was to investigate the effect of a Rasch-based procedure to calibrate responses for funding applications. The data set included 112 proposals and 66 readers, who independently scored randomly assigned proposals using a scoring instrument. The data were analyzed using FACETS (Linacre, 1999). The analysis indicated that the…

Investigated the interrater reliability of teachers' and school psychology externs' scoring of protocols for the Developmental Test of Visual-Motor Integration (VMI), using a revised scoring system. Results showed high reliability coefficients for all raters, regardless of the scoring system employed. The influence of rater training is discussed.…

Presents a method for evaluating student teachers' oral presentations as the final showcase stage of their portfolios. Describes assessment criteria for content, organization, accompanying materials, relationship to state standards, and delivery, as well as ways of ensuring interobserver reliability. (SK)

A competence assessment instrument that measures cognitive complexity used structured interviews to investigate means-goal relationships in different work activities. Validity and reliability were confirmed by two tests of interrater reliability and six tests of validity (content, face, and criterion). (Contains 27 references.) (SK)

Assesses the inter-rater reliability of two environmental scanning tools designed to identify alcohol-related advertisements targeting college students. Inter-rater reliability for these forms varied across different rating categories and ranged from poor to excellent. Suggestions for future research are addressed. (Contains 26 references and 6…

This commentary to EC 232 373 and EC 232 374 challenges the use of a speaker-based definition of stuttering and argues that use of the definition may only relocate the judgment reliability problem and raise as many validity problems as a listener-based definition of stuttering does. (JDD)

The interrater reliability of three interaction scales--the Maternal Behavior Rating Scale, the Rating Scales of Mother-Child Interaction, and the Teaching Skills Inventory--were estimated with four statistical techniques. The estimates varied widely, both within and across the three interaction scales. Suggestions are offered to help researchers…

Evaluates the validity of extrapolating research findings from the Monadic Phases Coding System (MP) to the Maximally Discriminative Facial Movement Coding System by coding videotapes of 12 4-month-old infants engaged in mother-infant interaction. (RJC)

Revised Client Verbal Response Category System by creating client behavior system (CBS), which includes eight nominal, mutually exclusive categories. When CBS was used to rate predominant client behavior in middle sessions, adequate interjudge agreement was found, with cognitive-behavioral exploration occurring most frequently. Client experiencing…