Single-case design is a research methodology that entails repeated measurement to assess the influence of an independent variable on a dependent variable over time. Data collected in this manner are regularly analyzed using visual analysis of data displayed in a linear graph. Although there is agreement regarding critical elements of visual…

This study examined the exchangeability of total scores (i.e., intelligent quotients [IQs]) from three brief intelligence tests. Tests were administered to 36 children with intellectual giftedness, scored live by one set of primary examiners and later scored by a secondary examiner. For each student, six IQs were calculated, and all 216 values…

The parent-teacher agreement has become an important issue of children's psychological assessment. However, the amount of research available for preschool children is small and mainly based on one index of agreement with samples of modest size/representativeness. This study examined parent-teacher agreement (correlations) and discrepancies (t…

Within the realm of school-based interventions, implementation integrity is important for practical, legal, and ethical purposes. Unfortunately, evidence suggests that proper monitoring of implementation integrity is often absent from both research and practice. School psychology practitioners and researchers have reported that a major barrier to…

The call for school psychologists to demonstrate accountability in the evaluation of services at the individual, group, and system levels comes at a time when school districts nationally are pursuing personnel evaluation models that link teachers' instructional practices to student achievement. School psychologists have an opportunity to take a…

Children's social and emotional competence abilities have been linked to successful social interactions and academic performance. This study examined the teacher and observer ratings of social and emotional competence for 89 young (3- to 5-year-old), African American children from economically stressed urban environments. There was a specific…

The reliability of data is a critical issue in decision-making for practitioners in the school. Percent Agreement and Cohen's kappa are the two most widely reported indices of inter-rater reliability, however, a recent Monte Carlo study on the reliability of multi-category scales found other indices to be more trustworthy given the type of data…

High-school students were shown an educational video designed to dispel 12 common myths regarding Attention-Deficit/Hyperactivity Disorder (ADHD) by describing each myth and then presenting accurate information. The experimental group viewed a video that was supplemented by the speaker acknowledging that he had ADHD and providing descriptions of…

Investigated the interscorer reliability between a novice and a professional psychologist for the Minnesota Percepto-Diagnostic Test-Revised (MPDT-R), using a sample of 30 individuals. Results indicated that for three of the four MPDT-R scores there was a significant positive correlation between expert and novice scoring criteria. (JAC)

Extends the reliability research of the Qualitative Scoring System for the Modified Version of the Bender-Gestalt Test. The test was administered to 48 children, and the 48 test protocols were scored independently by two psychologists using the Qualitative Scoring System. Results indicated that the scoring system is highly reliable. (JPS)

The traditional kappa statistic in assessing interrater agreement is not adequate when multiraters and multiattributes are involved. In this article, latent trait models are proposed to assess the multirater multiattribute (MRMA) agreement. Data from the Third International Mathematics and Science Studies (TIMSS) are used to illustrate the…

Compared traditional percentage and correlational methods of estimating reliability of duration recording to reliability obtained with event-by-event examination of observers' records in which the actual percentage of time that the observers were in agreement was calculated. Traditional percentage reliability scores were found to be significantly…

Evaluated interscorer reliability of the Spatial Memory subtest, which appears on the Simultaneous Processing scale of the Kaufman Assessment Battery for Children. Responses from 19 gifted children were scored by two independent examiners. Results showed this subtest may be prone to scoring errors because no permanent record of responses exists.…

Investigation of interrater agreement for the Adjustment Scales for Children and Adolescents (ASCA) discriminant classifications is reported. Two teaching professionals provided independent ratings of the same child using the ASCA. A total of 119 students ranging in age from 7 to 18 years were independently rated. Results indicated significant and…

Investigated the interrater reliability of teachers' and school psychology externs' scoring of protocols for the Developmental Test of Visual-Motor Integration (VMI), using a revised scoring system. Results showed high reliability coefficients for all raters, regardless of the scoring system employed. The influence of rater training is discussed.…