This study examined the difficulty level of essay topics used in the large-scale assessment of writing in relation to five different scoring models, and sought to determine what effects the scoring models would have on passing rates. In model one, examinee's score is the direct result of a score assigned by the reader or the sum of scores assigned…

A large pediatric residency program conducted an extensive analysis of the reliability and validity of the rating forms used to evaluate the pediatric residents enrolled in the program. Data indicate that although the reliability of individual ratings is very low, several factors achieved acceptable levels of reliability when aggregated.…

The purpose of this study was to take an initial step toward developing sound and versatile predictive instruments (i.e., benchmark measures) in reading, writing, and math that can be used to assess high-school students' academic performance in a manner that will not only predict scores on high-stakes tests but will also be amenable to repeat…

The need for effective ways of monitoring the quality of scoring of portfolios resulted in the development of a software package that provides scoring leaders with updated information on their assessors' scoring quality. Assessors with computers enter data as they score, and this information is analyzed and reported to scoring leaders. The…

This report discusses the outcomes of a study that investigated the consistencies and the differences revealed among teachers and school counselors when using the Behavioral and Emotional Rating Scale (BERS) to rate the strengths of children at three separate school levels: elementary, middle, and high school. The sample included 60 children (ages…

Describes a study that used qualitative analysis to determine the scope and interjudge agreement of personality information communicated to computer-using classroom teachers through three types of children's drawings: freehand, graphics tablet, and Logo. Children's drawings as psychological assessment tools are discussed and gender, age, learning…

The impact of overall test length and difficulty on the expert judgments of item performance by the Nedelsky method were studied. Five university-level instructors predicting the performance of minimally competent candidates on a mathematics examination were fairly consistent in their assessments regardless of length or difficulty of the test.…

Asserts that the whole-language approach requires broader evaluation procedures most often associated with alternative assessment methods. Discusses issues related to alternative assessment, such as goal setting, portfolios, and interrater reliability, as they apply to social studies. (CFR)

Teachers and parents rated the developmental status of 225 preschool children with and without disabilities on the Vineland Adaptive Behavior Scale. The study found a significant correlation between teacher and parent ratings for children with severe disabilities but not for children with mild/moderate or no disabilities. (DB)

This paper introduces the Website Acceptability Tiered Checklist (WATCH), a preliminary version of a multi-trait scale that could be used by instructors and students to assess the quality of websites chosen as source materials in students' research papers in a Humanities program. The scale includes bands for assessing: (i) the authority and…

This study explored how background factors are related to teachers' behaviors. Currently, it is unclear what variable most accurately predicts teaching behaviors; experience, general education, or specialized training. The participants in this study were 47 early childhood educators. Teachers were primarily female and all worked with children aged…

Objective: The aim was to construct and test the reliability (utility, internal consistency, interrater agreement) and the validity (internal validity, concurrent validity) of a scale for home visiting social nurses to identify risks of physical abuse and neglect in mothers with a newborn child. Method: A 71-item scale was constructed based on a…

Traditional assessment techniques may not afford all students the opportunity to demonstrate their knowledge and skills. Rubrics may help students reach the objectives of an assignment. In this study, two rubrics were introduced to 55 community college students in two sections of an undergraduate education class. The first rubric was used to grade…

A central dilemma of portfolio assessment is that as the richness of the data available to readers increases, so do the challenges involved in ensuring acceptable reliability among readers. Drawing on empirical and theoretical work in discourse analysis, ethnomethodology, and other fields, we argue that this dilemma results, in part, from the fact…

In this article, the authors report the psychometric properties of a parent-completed rating scale based on the criteria for oppositional defiant disorder (ODD) in the "Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition-Text Revision" ("DSM-IV-TR"). Mothers of 294 boys and 48 girls with…