Large-scale performance assessment programs are a longstanding reform tool. However, standard setting can be a challenge for assessment programs that use primarily non-standardized assessments. The purpose of this paper is to extend this field of research by explaining the standard setting methodology applied to one more recent instantiation of a…

Most states have developed or revised school accountability systems in response to the Every Student Succeeds Act (ESSA). While these systems include multiple indicators, to many stakeholders the outcome of central interest is the overall rating or classification produced for each school. These ratings are often used to identify schools that merit…

A task force was created in a small, AACSB-accredited business school to develop a more comprehensive set of standards for faculty performance. The task force relied heavily on faculty input to identify and describe key dimensions that capture effective teaching and service performance. The result is a multi-dimensional framework that will be used…

This is an exciting time to be in science education. New science standards are being developed by a group of science educators from across the country, working with 26 states in a process managed by Achieve, Inc., a non-profit education reform organization. The development of the "Next Generation Science Standards" (NGSS) promises to be the most…

The judgmental approaches used by the Governing Board to set National Assessment of Educational Progress achievement levels have been the subject of a great deal of controversy and have sometimes led to results that were considered "unreasonable." The NCES requirement that the achievement levels be used on a trial basis and be…

This paper describes how a state education system in Australia introduced standards-referenced assessments into its large-scale, high-stakes, curriculum-based examinations in a way that enables comparison of performance across time even though the examinations are different each year. It describes the multi-stage modified Angoff standard-setting…

Recently, there has been a significant expansion in the use of performance assessment in large scale testing programs. Although there has been significant support from curriculum and policy stakeholders, the technical feasibility of large scale performance assessments has remained a question. This report is intended to contribute to the debate by…

This paper explains the multifacet technology for analyzing performance examinations and the fair average method of setting criterion standards. The multidimensional nature of performance examinations requires that multiple and often different facets elements of a candidate's examination form be accounted for in the analysis. After this is…

A new method is proposed to set multiple standards in performance tests. The method combines three sources of information coming from three different data collections. The first is an empirical definition of mastery of an item; the second consists of parameter estimates of the items in an Item Response Theory (IRT) model, and the third source is a…

Two concerns related to setting performance standards on educational assessments are discussed. First, criteria for a standard-setting process from the point of view of a standard-setting sponsor, called here "institutional criteria," are developed using a state department of education as an example. Four institutional criteria are proposed: (a)…

Effective school leadership is key to students' academic success. But the development of effective school leadership has been seriously hampered by the lack of technically sound tools to assess and monitor leaders' performance. With support from The Wallace Foundation, a team from Vanderbilt has been developing such an assessment system, and this…

The National Board for Professional Teaching Standards (NBPTS) is developing a certification process, rather than a test, to confer distinction on experienced teachers who meet demanding standards. The role of performance assessment in this voluntary certification is discussed, and the research goals of the NBPTS are described. (SLD)

This paper provides a critical analysis of New Zealand's Performance Based Research Fund (PBRF). The first section sketches the development and implementation of the PBRF. The second section evaluates the scheme, concentrating on three themes: the relationship between privatization, competition and research performance; the standardization of…

Setting performance standards is an area that different constituencies see quite differently. The choices of elements for a particular standard depend to a large extent on the purposes the standard is intended to serve. Standards can be used in certification, as predictors, as descriptors, and as motivators. While performance standards indicate…

The New Standards Project is a partnership of 17 states and 6 major school districts that have joined to develop alternative approaches to setting educational standards and assessing student achievement. In the New Standards Project plan, formal standard setting occurs through a process of public examination of student work products on pilot…