This paper reports on a newly designed judgmental method for setting test performance standard that: (1) overcome many of the practical and psychometric problems associated with the Angoff and Ebel methods; (2) can be used to set multiple cut points on a score scale; (3) may be readily and efficiently implemented with assessments that use…

The implications of international assessments in setting world-class performance standards are explored. Possible uses of recent international assessments as benchmarks against which to compare the achievement of U.S. students are illustrated. Characteristics of international assessments that affect their usefulness as benchmarks are discussed.…

Purpose: The performance of low-income African American preschoolers (36 to 52 months old) on the Peabody Picture Vocabulary Test-Third Edition (PPVT-III; L. M. Dunn & L. M. Dunn, 1997) was examined to provide a norm for assessing the performance of this population and to explore the link between socioeconomic status (SES) and language scores on…

As constructed-response items become an integral part of educational assessments, setting student performance standards on constructed-response items has become an important issue. Two standard-setting methods, one used for setting standards on the National Assessment of Educational Progress (NAEP) in reading in grade 8 and the other used to set…

A study of the processes for establishing the principles and policies of measurement and disclosure in preparing financial reports examines differences in these processes in the United States, Canada, and England. Information was drawn from international accounting literature on standard setting. The differences and similarities in the…

Whether cutting score equivalents (CSEs) based on examinee performance are the same as CSEs based on expert judgment was examined using data from 3,262 examinees taking an internal medicine certification examination. CSEs produced by 40 physicians/experts were closer to the criteria than were standards derived from examinee performance. (SLD)

It was hypothesized that, when compared to the Angoff method (W. H. Angoff, 1971), the Nedelsky method (L. Nedelsky, 1954) for standard setting had lower intrajudge inconsistency, lower cutscores, and lower cutscores especially for items presenting challenges to the judges. These hypotheses were tested and supported in a sample of 22 graduate…

Whether common standards exist among the national standards for kindergarten through grade 12 mathematics, science, and civics and government was studied. Common standards were explored among "Curriculum and Evaluation Standards for School Mathematics," produced by the National Council of Teachers of Mathematics, the "National…

A comparison of four frequently used standard setting methods for deriving cut-off scores with respect to the expected performance of minimally competent students, is presented in this paper. Ten Kansas Competency Based Tests, in reading and mathematics, were administered across five grade levels in a state-wide minimal competency testing program.…

This article provides a framework for the rest of the articles in this special issue comparing the utility of three standard-setting methods with complex performance assessments. The context of the standard setting study is described, and the methods are outlined. (SLD)

Methods for setting cutoff scores based on criterion performance, normative comparison, and absolute judgment were compared for scores on a multiple-choice psychology examination for 121 undergraduates and 251 undergraduates as a comparison group. All methods fell within the standard error of measurement. Implications of differences for decision…

The purpose of this study was to compare different statistical and methodological approaches to standard setting and determining cut scores using R-CBM and performance on high-stakes tests. One thousand seven hundred and sixty-six students were followed longitudinally from first through third grades using R-CBM benchmark assessment. In addition,…

This article explores issues involved in using assessments as a means of defining standards and encouraging efforts to meet them. It compares the European examination system with the present American testing system. It also considers issues that must be faced in defining learning domains in ways that do not encourage narrowly focused training on…

The No Child Left Behind Act of 2001 (NCLB) and the 2004 reauthorization of the Individuals with Disabilities Education Improvement Act (IDEA 904) raise the achievement expectations of all students, including students with disabilities. These requirements place new responsibilities on institutions of higher education and state educational agencies…

When publications are used in the evaluation of research performance, tensions between the simplifying, standardizing approaches of evaluations and the communication practices of scientific communities are likely to arise. An analysis of data gathered in an evaluation at the Australian National University demonstrates that many academic…