This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

This paper describes a process used to assess the technical competency of non-direct line candidates for managerial positions in computer specialties. The Training and Experience (T&E) qualifying test, a multi-method approach combining task-based, computer scorable evaluations of training and experience with multiple-choice batteries, was used as…

Current conceptions of literacy and what being literate means are discussed, and the strengths and weaknesses of the standardized multiple-choice test as a tool for assessing literacy proficiency and a way to report learning progress are explored. The possible advantages of alternative assessment strategies are reviewed, and an assessment model is…

A study investigated the effectiveness of the Rasch procedure in measuring response appropriateness, especially for the detection of cheating on multiple-choice language tests. The report gives background information on appropriateness measurement and its potential uses, reviews recent research on cheating and its detection, and describes three…

A discussion of alternative evaluation techniques looks at tests that college students retake at home immediately after completing in class; exams requiring thoughtful application; group multiple-choice tests; paired testing; answer justification; a variety of take-home exams; immediate feedback; cost/benefit testing; retesting; and reaction or…

The purpose of the conference, "Wagging the Dog, Carting the Horse: Testing vs. Improving California Schools," was to discuss alternative perspectives on testing and evaluation in education and their role in improving teaching and learning. Four papers were presented: (1) "Using Educational Evaluation for the Improvement of California Schools," by…

The papers in this monograph address an issue of importance to educational policy and practice: the use of testing and evaluation to assess the quality of education and to facilitate school improvement. The authors consider the traditional role that testing has played in accountability and the role that assessment and evaluation can and should…

Performance assessment is reviewed as an emerging form of alternative assessment, focusing on how it has been defined in the research literature, the criteria for evaluating its authenticity, the measurement of process and product, and the link between assessment and instruction. Three important dimensions that must be considered in describing…

New York State United Teachers (NYSUT) established a Task Force on Student Assessment in the spring of 1990, which was designed to: review available information on testing principles and practices; make recommendations for reform of testing; and communicate its findings to NYSUT members. Ten recommendations were made, centering on the necessity…

This paper describes a study that investigated the interchangeability of four different assessment methods for measuring middle-school students' understanding of science concepts. The four methods compared were hands-on tasks with associated multiple-choice and written justification items, written analogues of the hands-on tasks, and two types of…

A review of the recent literature has yielded a number of concerns about the validity, reliability, cost, efficiency, generalizability, utility, and cultural sensitivity of performance based assessments. The resulting conclusion was that continuing the performance based assessment initiative should be rethought. Suggested alternatives included…

Issues of the relative costs of multiple choice tests and alternative types of assessment are explored. Before alternative assessments in large-scale or small-scale programs are used, attention must be given to cost considerations and the resources required to develop and implement the assessment. Major categories of cost to be considered are…

The role and influence of mandated testing in educational reform are reviewed. Mandated testing refers to large-scale (districtwide or statewide) multiple-choice testing programs used for policy purposes of evaluation and accountability, which includes nationally normed standardized achievement tests and tests custom-developed to reflect state and…

This book for college faculty provides a resource for developing, using, and grading classroom exams. The first chapter addresses ways to determine what content should be included on an exam. The second chapter identifies testing considerations such as number of exams, difficulty level of items, and test length. Chapters 3 and 4 provide guidelines…