Describes a FORTRAN software program that calculates the probability of an observed difference between agreement measures obtained from two independent sets of raters. An example illustrates the use of the DIFFER program in evaluating undergraduate essays. (Author/SLD)

A 2-facet measurement model is identified, and its coefficient of generalizability (CG) is examined. Three other multifaceted measurement models and their CGs are identified. An empirical investigation of all four procedures is conducted using data from a study of the psychopathology of 71 prison inmates. (SLD)

This study examined the comparability and predictive validity of three approaches to measurement of child or adolescent maltreatment, involving the adolescents themselves (n=160), case file review by researchers, and protection agency social workers. Comparison of ratings across sources indicated considerable disagreement with respect to judgments…

Observers and mothers rated infant behavior in the home on dimensions of temperament once a week for eight weeks. Although week-to-week correlations were modest, aggregates of the eight observations had high reliability for both observers and mothers. When direct observations were compared with mother reports, little evidence of mother-observer…

Studied African American culture, using a new, shortened, 33-item African American Acculturation Scale (AAAS-33) to assess the scale's validity and reliability. Comparisons between the original form and AAAS-33 reveal high correlations, however, the longer form may be sensitive to some beliefs, practices, and attitudes not assessed by the short…

Reviews research that sheds light on the comparability of Oral Proficiency Interview and the Simulated Oral Proficiency Interview. Suggestions are provided for further research. (16 references) (VWL)

Fifteen deaf and 11 hearing children (ages 8-10) witnessed slides depicting a wallet theft and were interviewed using a free recall approach followed by increasingly directive questions. Although accuracy of the two groups did not differ in free recall, deaf children provided less accurate responses to directive questions, whereas accuracy of the…

Reviews commercially available instruments to assess students' study skills/habits/behavior, finding that none completely meets the standards set by the American Psychological Association or the American Educational Research Association. Offers guidance on selecting and applying these instruments in college settings. (DMM)

In a recent article in this journal, Lombard, Snyder-Duch, and Bracken (2002) surveyed 200 content analyses for their reporting of reliability tests, compared the virtues and drawbacks of five popular reliability measures, and proposed guidelines and standards for their use. Their discussion revealed that numerous misconceptions circulate in the…

Purpose: The purpose of this paper is to empirically test a new industry-specific scale, HEdPERF (Higher Education PERFormance) to capture the authentic determinants of service quality within higher education sector. Design/methodology/approach: The primary goal of this research was to test and compare the relative efficacy of HEdPERF against…

This study sought to explore the emotional intelligence of Form One mathematics and science teachers. The emotional intelligence of the teachers was determined using the Emotional Intelligence for Mathematics and Science Teachers (EIMST) survey instrument. It was adapted and adopted from related instruments and then pilot tested for validity and…

This study compared different stakeholders' perceived validity of various indicators of student learning used to judge the quality of students' academic performance. Data were gathered from the questionnaire responses of 314 educators in three states that have implemented comprehensive state-wide assessment programs with high-stakes consequences…

In response to growing concern about the lack of basic writing skills, this paper presents an overview of the issues involved in selecting a method for the assessment of students' writing skills. After general criteria for determining the appropriateness of a writing evaluation procedure are outlined, the merits and limitations of objective tests…

Three techniques for estimating Kuder Richardson reliability (KR20) coefficients for incomplete data are contrasted. The methods are: (1) Henderson's Method 1 (analysis of variance, or ANOVA); (2) Henderson's Method 3 (FITCO); and (3) Koch's method of symmetric sums (SYSUM). A Monte Carlo simulation was used to assess the precision of the three…