This study explored and compared the ways in which school-based cooperating teachers and college supervisors evaluate student teachers. The scores allocated to student teachers by school-based cooperating teachers and college supervisors in the final field experience evaluations of student teachers were analyzed. A mixed methods research design…

Purpose: To determine the psychometric properties of the Preschool Repetition (PSRep) Test (Roy & Chiat, 2004), to establish the range of performance in typically developing children and variables affecting this performance, and to compare the performance of clinically referred children. Method: The PSRep Test comprises 18 words and 18…

This study examines how feedback interest after career assessment can be influenced by changing individuals' beliefs about the importance and modifiability of the various performance dimensions. In an experiment, 82 master students completed a computerized assessment tool developed for assessing managerial potential. Results showed that…

Objective: Current theories hypothesize that deficits in executive functioning (EF) are responsible for the symptoms of ADHD and that specific patterns of EF deficits may be associated with different subtypes of ADHD. The present study evaluates the validity and clinical usefulness of the Behavior Rating Inventory of Executive Function, a behavior…

Objective: In this qualitative study, the authors examined how students attempt to minimize harm to themselves and others when drinking. Participants: The authors recruited freshmen at a large, mid-Atlantic US public university during the fall semester of 2005 to participate in 8 focus groups. Methods: The moderator's guide was developed through…

This study investigated the use of adapted bicycles on the acquisition, maintenance, and generalization of conventional cycling by seven children with mild mental retardation. Feedback was used in addition to the adapted bicycles and consisted of pedal rate, head position, and steering participation. A multiple probe design was used. Participants…

Purpose: The purpose of this study was to evaluate the utility and reliability of a home hazard checklist published in Health Canada, "The Safe Living Guide: A Guide to Home Safety for Seniors" (2003). Methods: 76 community-dwelling seniors evaluated the guide, and inter-rater reliability was determined through comparison of ratings of…

Examined the effects of order of stimulus presentation on observer ratings of counseling performance. Results revealed a statistically significant interaction between quality of performance and the order in which the performances were rated. (Author/ABB)

Analysis of gymnastics judges scores of their own and other countries' gymnasts' performance during the 1984 Olympic Games indicated that the judges were biased in favor of their own country's gymnasts. (Author/CB)

Three experienced neuropsychologists rated brain damaged and control subjects for brain damage using the Halstead-Reitan Battery and the Luria-Nebraska Neuropsychological Battery. Using either battery, raters were accurate in judging the presence of brain damage. There was a high degree of consistency between raters and test batteries when both…

This program computes multiple judge reliability levels under the following conditions. (1) different sets of judges perform the ratings; (2) the number of judges is a constant; and (3) the scale of measurement is nominal. (Author)

Investigated the interscorer reliability between a novice and a professional psychologist for the Minnesota Percepto-Diagnostic Test-Revised (MPDT-R), using a sample of 30 individuals. Results indicated that for three of the four MPDT-R scores there was a significant positive correlation between expert and novice scoring criteria. (JAC)

Fleiss' popular multirater kappa is known to be influenced by prevalence and bias, which can lead to the paradox of high agreement but low kappa. It also assumes that raters are restricted in how they can distribute cases across categories, which is not a typical feature of many agreement studies. In this article, a free-marginal, multirater…

Used Monte Carlo simulation to compare the properties of a goodness-of-fit (GOF) procedure and a test statistic developed by E. Bartfay and A. Donner (2001) to the likelihood ratio test in assessing the existence of extra variation. Results show the GOF procedure possess satisfactory Type I error rate and power. (SLD)

Generalizability Theory can be used to assess reliability in the presence of multiple sources and different types of error. It provides a flexible alternative to Classical Theory and can handle estimation of interrater reliability with any number of raters. (SK)