Because of concerns about the validity of tests used in education and employment, a consultation on June 16, 1989, focused on tests of ability, achievement, and other skills. Invited experts were asked to address a set of issues common to both education and employment testing, primarily related to test construction procedures and how to establish…

A review of the recent literature has yielded a number of concerns about the validity, reliability, cost, efficiency, generalizability, utility, and cultural sensitivity of performance based assessments. The resulting conclusion was that continuing the performance based assessment initiative should be rethought. Suggested alternatives included…

Scholastic achievement tests and mental ability tests normally consist of a set of multiple choice items, all of which are assumed to measure school-relevant cognitive abilities. The presumption, in a given test situation, is that the answers/solutions to the given tasks represent cognitive capabilities on the part of the examinees. The purpose of…

The results of an evaluation of Vermont's statewide assessment initiative are presented, with information about the implementation of the program, its effects on educational practice, the analytic challenge presented by the portfolio scoring process, the reliability and validity of portfolio scores, and the tensions between assessment and…

This study investigated whether the criterion-related validity coefficient of the Instructional Strategy Usage (ISU) instrument was statistically significant, and investigated factors related to general education teachers' use of instructional strategies that facilitate inclusion of students with moderate and severe impairments in general…

The primary purpose of testing in early childhood is to identify children who may be at risk for learning problems so they may be placed in appropriate educational environments. Testing is popular because educators take at face value the claim by test developers that using standardized test instruments to classify, retain, or promote children is…

Standards-based assessment, or at least the concept of standards-based assessment, will provide a key strategy for the implementation of the New Zealand National Qualifications Framework. This paper considers the meaning of standards-based assessment and its role in New Zealand's assessment for nationally recognized qualifications. Standards-based…

In September 1991, the National Assessment Governing Board (NAGB) announced standards for basic, proficient, and advanced achievement in mathematics and reported that few American students had reached these standards. Expert reviewers noted technical problems with the NAGB approach and questioned its results. In this report, the NAGB…

Testing and assessment that are "more authentic" (performance-based or alternative) represent the most pressing issue in education today. Some of the major criticisms leveled at standardized testing are examined, and the advantages and disadvantages of more authentic assessment are reviewed. A general direction for integrating traditional and…

The California Critical Thinking Skills Test: College Level (CCTST) is a standardized test that targets core college-level critical thinking skills. It has been characterized as the best commercially available critical thinking skills assessment instrument. Building from CCTST validation studies in 1989 and 1990, this paper proposes avenues for…

Some potential relative advantages of performance assessment strategies over paper-and-pencil tests using short-answer and multiple-choice item formats are discussed. The major advantage of the multiple-choice test is its ability to sample a large number of learning outcomes efficiently. However, performance assessments are increasingly being used…

In problem-based learning, an instrument is needed to measure students' actual learning activities. Mapping the domain of learning activities undertaken by students and improving problems is especially important in a problem-based curriculum because students choose their own learning objectives. Such an instrument, the Topic Evaluation…

Issues pertaining to research on college reading and study skills programs are analyzed, based on a literature review. It is suggested that before educators can provide quality instruction, they need to differentiate practices that are conducive to learning. Evaluative criteria are needed to make such decisions, as well as to design and evaluate…

The decision by the National Institute of Education panel on the effects of school desegregation to select (for meta-analysis) a small group of preferred studies based upon criteria chosen in advance of examining the studies was, in principle, a mistake. One usually cannot know until the data have been examined which of several competing…

A series of studies that investigated the validity of abilities learned in college for later career and professional work are summarized. After describing the rationale for validating outcome-centered higher education curricula, the following types of measures for program evaluation and outcome validation are discussed: performance measures of…