In their article "Innovations in Setting Performance Standards for K-12 Test-Based Accountability," Kristen Huff and Barbara S. Plake (2010) lay out three preconditions for continued investment in standard-setting methodology and practice, all focused on the sound development and use of achievement level descriptors (ALDs). Among these…

Standard setting is a systematic process that uses a combination of judgmental and empirical procedures to make recommendations about where on the score continuum "cut scores" should be placed. Cut scores divide the score scale into categories consistent with the descriptions of student performance associated with multiple levels of achievement.…

This paper describes how a state education system in Australia introduced standards-referenced assessments into its large-scale, high-stakes, curriculum-based examinations in a way that enables comparison of performance across time even though the examinations are different each year. It describes the multi-stage modified Angoff standard-setting…

Standard-setting research has yielded a rich array of more than 50 standard-setting procedures, but practitioners are likely to be confused about which to use. By synthesizing the accumulated research on standard setting and progress monitoring, this study developed a three-dimensional taxonomy for conceptualizing and operationalizing the various…

Characterizing this special "Kappan" section on test-based accountability as a cautionary plea, this article sees five themes: tests seldom measure what matters; standardization gets confused with standards; tests constitute a limited reform lever; test-based accountability plans often misplace trust and protection; and the…

It is now seen as an economic and political necessity for countries to produce higher levels of performance across the spectrum of ability of all their students. This paper describes one example of the influence of political conditions on the process of developing assessment instruments and on measuring standards. In England, the trend is toward…

In the context of controversy over the use of high stakes testing, the Pennsylvania State Education Association (PSEA) asked for an evaluation of the performance levels and cut score of the Pennsylvania System of School Assessment (PSSA) mathematics and reading tests. While awaiting technical documentation from the Pennsylvania Department of…

A statistical technique is presented for developing performance standards based on benchmark groups. The benchmark groups are selected using a multivariate technique that relies on a squared Euclidean distance method. For each observation unit (a school district in the example), a unique comparison group is selected. (SLD)

Performance standards are useful tools when comparative evaluation or personal selection are not appropriate for decision making. The concept was developed in 1962 when Glaser introduced criterion referenced testing, to emphasize the importance of making test scores informative about learning processes rather than comparing them to other people's…

In the current climate of accountability in American public education, tests get more attention and carry more importance than ever before. Both state accountability systems and the federal No Child Left Behind Act (NCLB) hold schools accountable for whether students pass standardized state tests. NCLB requires that schools and school districts…

This article examines major threats to the validity of Adequate Yearly Progress (AYP) in the context of rural schools. Although rural students and their schools made significant academic progress in the past on national and state assessments, the current goal of AYP turns out to be highly unrealistic for them unless states set far lower…

Test results and employer complaints indicate that the average high school graduate hasn't learned enough and that he brings that deficit with him to college. As remedy, Chester Finn argues for uniform educational standards and measurements in a transparent reporting system that gives families the information necessary to scrutinize and accept or…

Compares two approaches for establishing student achievement standards and expectations for province-wide assessment in Saskatchewan (Canada). The first approach based standards on judges' estimates regarding the percentage of students who should be able to attain desired levels of performance. The second approach required judges to reach a…

The accountability testing programs of many states have begun to make extensive use of constructed-response questions and to report test results in terms of percentages of students at various proficiency or performance levels. This paper describes the step-by-step procedures for two standard-setting methods recently used for the New Hampshire…

This paper describes the processes that one school district, the Visalia Unified School District (California), went through in establishing a standards-based assessment and accountability system using multiple methods. First the district's standards-based assessment and accountability system and the methods used to establish it are described, and…