Specific steps for applying the Angoff method are described. In the Angoff method, judges are asked to estimate the probabilities of minimally competent candidates' answering multiple choice test items correctly. Initial information must be obtained for designing the standard-setting process, beginning with the purpose of the examination and any…

Traditionally, judgmental standard setting methods have been used exclusively at the test item level. In this study, the Ebel and Angoff methods of standard setting were utilized to determine minimum competency standards on a list of 175 identified competency statements for vocational evaluators. The following research questions were addressed:…

Exams which are periodically updated and revised also require a revision of the cut score to ensure that examinees who take the original form of the test, and those taking the revised form, are scored on an equivalent basis. This paper discusses available standard setting procedures as applied to establishing minimum passing scores for licensing…

Numerous techniques are available for determining cutoff scores for distinguishing between proficient and non-proficient examinees. One of the more commonly cited techniques for standard setting is the Nedelsky Method. In response to criticism of this method, Gross (1985) presented a revised Nedelsky technique. However, no research beyond that…

The problem of standard setting on language proficiency tests is often approached by the use of norms derived from the group being tested, a process commonly known as "grading on the curve." One particular problem with this ad hoc method of standard setting is that it will usually result in a fluctuating standard dependent on the particular group…

This booklet outlines a specific set of strategies that campuses with negative Greek behavioral issues can use to close the gap between what fraternities and sororities espouse and what their chapters do. Specifically, six recommendations are proposed that are designed to eliminate negative collegiate fraternity and sorority behaviors involving…

This paper focuses on the formulation and adoption of content standards in California. The standards-setting process is examined through the theoretical lens of deliberative democracy in order to develop a better understanding of the process and to assess the extent to which the institutions charged with deciding what students should learn can act…

The Achievement-Levels Setting (ALS) process for the National Assessment of Educational Progress (NAEP) resulted in numerical cutscores on the NAEP score scale representing the performance standards for three achievement levels: Basic, Proficient, and Advanced. This paper focuses on an important, but less researched, aspect of the standard setting…

In 1997, the Education Department of Western Australia, in conjunction with the teachers' union, initiated a trial project to establish a career path for teachers. Standards are to be set for the career path for three stages: (1) entry to Level 1; (2) transition from Level 1 to 2; and (3) transition from Level 2 to 3. This paper discusses the…

In 1999 a validation study of the 1998 Civics Assessment of the National Assessment of Educational Progress (NAEP) was conducted, combining a similarity classification study and a booklet classification study. The rationale was that if the teachers who had participated in the 5-day achievement levels-setting process could not use the descriptions…

A key component of the Angoff (W. Angoff, 1971) method for setting cut scores is the target examinee. Expert judges are asked, following training and discussion, to consider the ability and the likely performance of some subset of examinees and to then estimate, item by item, the likely performance of such examinees on the test for which a cut…

Examines controversies over national and state standard setting (Goals 2000, outcome-based education) involving conservative citizen groups. Makes recommendations for widening public participation in educational policy-making and aligning public engagement with standards-based reform. (SK)

The dominant profile judgment method, designed for use with profiles of polytomous scores on exercises in a performance-based assessment, is presented as a standard-setting method. The approach guides standard-setting panelists in articulating their standard-setting policies and allows for complex policy statements. (SLD)

Discusses what independent institutions of higher education said when surveyed about financial reporting practices and the desirability of an operating measure. Describes findings concerning who reports an operating measure, what is included as operating revenue, what is included as operating expense, how related disclosures are handled, and the…

Research from social psychology on the effects of group discussion and of exposure to the opinions of other group members on the decisions groups make is reviewed. The pertinence of this research to standard-setting practices is considered, and the implications for the design of standard-setting procedures are explored. (SLD)