In response to growing concern about the lack of basic writing skills, this paper presents an overview of the issues involved in selecting a method for the assessment of students' writing skills. After general criteria for determining the appropriateness of a writing evaluation procedure are outlined, the merits and limitations of objective tests…

A study examined the extent to which a 19-item short form of the Speech Evaluation Instrument (SEI) is a reliable instrument, what factor structure emerges from the analysis, and how that factor structure compares to that reported for the 30-item long form of the SEI. Subjects, 606 undergraduates enrolled in speech communications classes at two…

The author traces reasons to support his contention that the state of the art in assessing learning disabled students is not good. Among issues examined are the following: use of tests for purposes other than those for which they were intended; technical adequacy of currently used tests (standardization, reliability, validity); the use of deficit…

The use of the intraclass correlation in determining reliability is discussed and shown to be both appropriate and simple to use in the case of an observational measure, provided that observations are made on at least two occasions. The interpretation of such coefficients is explained in terms of generalizability theory, and real data are used to…

The evaluation of a testing program is necessary before or during a sound total project evaluation. Ideally, the testing program study should be concurrent with, and equal in magnitude to, the total project evaluation. Step one in an evaluation is to define the testing program's objectives in operational terms. Step two is a thorough description…

A new approach to measurement in education is suggested which affords some hope that the traditional view of examining can be given a better justification. (JD)

Content validity is an overriding problem in all measures evaluating written expression because there is no complete model of written language. Direct atomistic measures have greater instructional utility in diagnostic assessment, grouping, monitoring and decision making, reporting student progress, and giving feedback to students than do indirect…

Since credit-by-examination is an intrinsically sound educational device, those who administer it might well take steps to protect it from abuse. Colleges should insist that both content specialists and measurement experts participate in evaluating the tests and the College Entrance Examination Board should revise its procedures so that…

The reliability and validity of chance-level scores should be investigated. Only a careful examination of such scores can suggest whether they are likely to reflect random responding or to represent a reasonable estimate of an examinee's ability. (Author/RL)

The generalizability of student evaluations of college instruction is analyzed and generalizability theory data collected in a common design is applied. Results suggest that use of student evaluations of teacher effectiveness may lead to decisions based upon undependable data. (Author/GK)

Summarizes state-of-the-art approaches for assessing visual stimulus same/different judgments in individuals with severe intellectual disabilities. Methodological investigations indicate that one can obtain reliable same/different judgments with a variety of stimuli in virtually anyone for whom a basal score on the Peabody Picture Vocabulary Test…

A study with 10 developmentally delayed children between the ages of 52 and 80 months found that test-retest samples resulted in greater variability for lexical and morphological measurements than split-half transcripts. It was also found that 50-utterance sample segments contained 70-80 percent of the lexical information found in 100-utterance…

This paper reviews the psychometric properties, treatment utility, and conceptual basis of instruments used to identify the functions of aberrant behaviors in people with developmental disabilities. Instruments include the Motivational Assessment Scale, Motivation Analysis Rating Scale, Functional Analysis Interview Form, and Functional Analysis…

This study describes the development of the Active Treatment Client Rights checklist (ATCR), which was designed to facilitate the assessment, monitoring, and implementation of readily observable client active treatment services for adults with developmental disabilities. The ATCR was found to be highly reliable, valid, and useful in enhancing…

This assessment of the reliability and validity of skills analysis programs within curriculum-based measurement (CBM), with various groups of handicapped and nonhandicapped youngsters, indicated that the skills analysis programs in spelling and math provided consistent information that related well to the primary graphed CBM scores. (Author/JDD)