Teacher performance evaluation plays a key role in educational personnel reform, so it has been an important yet difficult issue in educational reform. Previous evaluations on teachers failed to make strict distinction among the three dominant types of evaluation, namely, capability, achievement, and effectiveness. Moreover, teacher performance…

This research emerged from an effort to develop a theory of computer anxiety relevant to beginning adult learners in a range of university disciplines. To this end, the first step was to design and refine an instrument which was reliable and valid for this population. The development of the "a priori" model of computer anxiety used in this study…

The "Standards for Educational and Psychological Testing" of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education are intended to provide a comprehensive basis for evaluating tests. This digest identifies key standards applicable to most test…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

Whether item response theory (IRT) is useful to the small-scale testing practitioner is examined. The stability of IRT item parameters is evaluated with respect to the classical item parameters (i.e., p-values, biserials) obtained from the same data set. Previous research investigating the effect of sample size on IRT parameter estimation has…

An experimental test battery consisting of several tests that measure aspects of artistic judgment was administered to over 1,600 clients of the Johnson O'Connor Research Foundation. The battery consisted of the Visual Aesthetic Sensitivity Test (VAST) of K. O. Gotz (1981); the Design Judgment Test (DJT) of M. Graves (1948); and two tests…

A comprehensive Instrument for Curriculum Evaluation (ICE) was developed to qualitatively and quantitatively evaluate curriculum materials. The instrument contains 115 statements for assessing 11 aspects of curriculum: philosophy, needs assessment, theme, goals, learning objectives and standards, scope and sequence, field testing, instructor…

Attention deficits and attention deficit-hyperactivity disorder (AD-HD) are regarded as relatively common disorders among school-age children, but the literature reveals several confounding factors with the standard assessment techniques for the disorder. Using a structured thematic apperception technique (the TEMAS Apperception Test of G.…

No issue in schools and communities today commands the concern and urgency of the U.S. public as much as the dangers of alcohol and other drug (AOD) use among youth. This guide therefore provides descriptive information on the variety of surveys of student alcohol and other drug use currently available, and delineates the issues involved in…

A study was conducted to provide insight into the consistency of reading achievement scores from four standardized tests. Several sets of data were compared to assess the accuracy of grade equivalents or instructional reading levels obtained on standardized tests. Each test was randomly assigned for administration to 23 third graders in a group…

This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…

Educators are called upon to improve the quality of classroom tests to enhance the learning of content. Less faculty concern for tests than for other features of instruction, compounded by a lack of knowing how to assess different levels of learning with test questions that measure complex processes, appear to generate poor quality classroom…

An overview is presented of the current status of competency testing for teacher certification. The question of the effect of certification tests on the quality of hired teachers is briefly discussed. Statistics are presented on types of tests used by various states, with particular attention to differences in the cut-off scores for passage of a…

Recent information from established testing programs was used to investigate the nature and limitations of essay and multiple-choice tests of writing ability, the statistical relationship of these types of tests, the performance of population subgroups on each, the possible need of different disciplines for different tests of composition skill,…

A set of procedures for validating the Army's Skill Qualification Tests (SQT) are described. Three phases are discussed: (1) the selection of tasks, (2) the selection of specific content for hands-on performance test items, and of written self-evaluation components, and (3) the establishment of content validity of the hands-on component. The task…