The Interrater/Test Reliability System (ITRS) is described. The ITRS is a comprehensive computer tool used to address questions of interrater reliability that computes several different indices of interrater reliability and the generalizability coefficient over raters and topics. The system is available in IBM compatible or Macintosh format. (SLD)

Investigates reliability and validity of speech evaluation instruments used in public speaking classes. Finds that student speeches can be evaluated reliably and validly using any of a number of different evaluation forms that address the fundamental speech constructs of content and delivery. Finds that lack of extensive rater training and…

A survey of 279 undergraduates examined the validity and reliability of "The Courage to Heal Workbook" (TCHW) checklist and whether the checklist can distinguish between participants reporting sexual abuse histories and those who did not. The checklist had robust reliability and could significantly discriminate between survivors and…

The psychometric properties of the Motivation Assessment Scale were examined using 90 ratings of different problem behaviors among 86 individuals with mental retardation. Although reliability and internal consistency were generally poor, the results depended upon topographies of problem behavior and methods of calculation. The construct validity…

Data from the experimental functional analysis of challenging behaviors of 27 individuals with mental retardation were analyzed to assess agreement among three forms of interpretation. Results found that the methods of interpreting function from experimental assessment can give different results and that test-retest reliability of the experimental…

The validity of the Child Abuse Potential (CAP) Inventory was tested with a sample of 40 child physical abusers and 40 nonabusers in Argentina. More than 97% of subjects were correctly classified as abusing or nonabusing individuals. The article is in Spanish. (CR)

Discusses the development of the Multicultural Competence in Student Affairs-Preliminary 2 (MCSA-P2) Scale, an assessment tool to measure multicultural competence in a higher education context. Reports the results of two studies that investigated the validity and reliability of the MCSA-P2. Explores future research needs as well as applications…

Examines the reliability and validity of the scores of the Assessment of Academic Self-Concept and Motivation Scale (AASCM), a new instrument developed according to motivational systems theory. The AASCM was administered to African American, European American, and Hispanic participants (N=492). Presents evidence of the measurement's strong…

When raters assign different scores to a performance task, a method for resolving rating differences is required to report a single score to the examinee. Recent studies indicate that decisions about examinees, such as pass/fail decisions, differ across resolution methods. Previous studies also investigated the interrater reliability of…

This paper presents a row-column (RC) association model in which the estimated row and column scores are forced to be in agreement with a priori specified ordering. Two efficient algorithms for finding the order-restricted maximum likelihood (ML) estimates are proposed and their reliability under different degrees of association is investigated by…

Throughout the United States, schools and entire school districts are implementing school-wide positive behavioral supports. This systemic, team-based approach often employs assessment tools such as The Effective Behavioral Support Survey (Sugai, Todd, & Horner, 2000) as part of its implementation to improve school-wide discipline. The EBS…

The report provides detailed information about the methods and instruments used to evaluate school readiness initiatives, discusses important considerations in selecting instruments, and provides resources and recommendations that may be helpful to those who are designing and implementing school readiness evaluations. Study results indicate that…

This pragmatic, accessible book presents an empirically supported conceptual framework and hands-on instructions for conducting curriculum-based measurement (CBM) in grades K-8. The authors provide everything needed to evaluate student learning in reading, spelling, writing, and math; graph the resulting data; and use this information to make…

This article describes the development and evaluation of a short form of the 24-item Adaptation to Age-Related Vision Loss (AVL) scale. The evaluation provided evidence of the reliability and validity of the short form (the AVL12), for significant interindividual differences at the baseline and for individual-level change in AVL scores over time.…

This paper describes the development of the interRAI-Intellectual Disability (interRAI ID), a comprehensive instrument that assesses all key domains of interest to service providers relative to a person with an intellectual disability (ID). The authors report on the reliability and validity of embedded scales for cognition, self-care, aggression,…