The most popular methods for setting passing scores and other standards on educational tests rely heavily on subjective judgment. This paper presents and evaluates a new procedure for setting and evaluating standards on tests based on cluster analysis of test data. The clustering procedure was applied to a statewide mathematics proficiency test…

This article provides a framework for the rest of the articles in this special issue comparing the utility of three standard-setting methods with complex performance assessments. The context of the standard setting study is described, and the methods are outlined. (SLD)

The purpose of this guide is to provide state and local Job Training Partnership Act (JTPA) program administrators with an approach to developing meaningful and relevant negotiated performance standards that will serve as a management and evaluation tool. The guide is organized in four chapters. Chapter I provides background information on the…

The process of assigning grades to students is analyzed, and a specific approach to grading is recommended that distinguishes between minimal and developmental objectives. Criterion-referenced and norm-referenced concepts are used in the approach, which is best suited for secondary school or college. (SLD)

It is argued that the modification of the Nedelsky procedure proposed by L. J. Gross is a valid approach to setting standards when clinical reasoning is measured using multiple-choice questions. An example from the Medical Council of Canada's Qualifying Examination for approximately 2,400 examinees demonstrates the procedure's value. (SLD)

This volume contains an edited transcript of the Rockefeller Institute's October 29, 2007 symposium (Chicago, IL) entitled "Intergovernmental Approaches to Strengthen K-12 Accountability Systems" as well as a framework paper circulated in preparation for the symposium. The transcript begins with a list of the forty state and federal education…

This article explores issues involved in using assessments as a means of defining standards and encouraging efforts to meet them. It compares the European examination system with the present American testing system. It also considers issues that must be faced in defining learning domains in ways that do not encourage narrowly focused training on…

This paper describes the processes that one school district, the Visalia Unified School District (California), went through in establishing a standards-based assessment and accountability system using multiple methods. First the district's standards-based assessment and accountability system and the methods used to establish it are described, and…

Field trials were conducted to test rating methods and the impact of feedback about consequences for the 1998 achievement levels-setting (ALS) process for the National Assessment of Educational Progress (NAEP). The field trials provided the opportunity to try out different methods similar to those used successfully by others, as well as to try out…

The research reported in this paper was conducted to gain information to guide the selection of standard setting procedures for use with polytomous items to set achievement levels on the National Assessment of Educational Progress (NAEP) assessments in U.S. History and geography. Standard-setting procedures were evaluated to determine the relative…

Of concern to private and public schools in Russia is the evaluation of teachers and schools. The use of voluntary, nongovernmental peer evaluation using extant Western accreditation processes is one choice that is being used in several public and private schools in Russia. This system of peer evaluation and friendly criticism contrasts markedly…

This report presents the results of an initial, iterative performance standards-setting (SS) task of a comprehensive on-the-job statewide teacher assessment system--the System for Teaching and Learning Assessment and Review (STAR). The 1990-91 STAR assesses and makes inferences about the quality of teaching and learning on sets of assessment…

The description of achievement levels is important to the process of reporting student performance on the National Assessment of Educational Progress (NAEP). A process was designed to develop achievement level descriptions (ALDs) for writing and civics. To begin, focus groups were conducted in each of the four NAEP regions for both writing and…

OSCE examinations were held in May and June 2002 for all third and fourth year and some fifth year medical students at the University of Leeds. There has been an arbitrary pass mark of 65% for these examinations. However, we recognise that it is important to adopt a systematic approach towards standard setting in all examinations so held a trial…

Neither teacher-made tests nor the Scholastic Aptitude Test are appropriate for measuring the attainment of national education goals. Most practitioners involved in discussions of national high-stakes examinations argue that new tests are needed. A new system that preserves state and local autonomy in education as it measures the attainment of…