One year before the National Education Summit, Congress had reauthorized the National Assessment of Educational Progress (NAEP) and created a National Assessment Governing Board to develop and oversee policy for the NAEP. In conjunction with the call to establish national education goals, efforts are being made to establish standards for…

Some of the different approaches to standard setting are discussed. Brief comments and references are offered concerning strategies that rely primarily on the use of expert judgment. Controversy surrounds methods that use expert judges, as well as those using test groups to set scores empirically. A minimax procedure developed by H. Huynh, an…

The emergence of frequency modulation or FM radio signals, which arose from the desire to free broadcasting of static noise common to amplitude modulation or AM, has produced the controversial development of stereo broadcasting. The resulting enhancement of sound quality helped FM pass AM in audience shares in less than two decades. The basic…

Historically, radio broadcasting has been affected by innovational, social, technological, and economic change. For instance, FM (frequency modulation) radio emerged out of a desire to free broadcasting of static noise common to AM (amplitude modulation) signals. The eventual response by AM was to improve the technology of the signal. The inquiry…

In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

Setting standards for the purpose of certification is frequently performed using judgmental techniques such as the Angoff method. This study was performed to identify types of items that judges find hard to rate accurately, that is, types of items on which examinees perform differently than predicted by the judges. Once identified these item types…

The use of item response theory models for analyzing the results of judgmental standard setting studies (the Angoff technique) for establishing minimum pass levels is discussed. A comparison of three methods indicates the traditional approach may not be best. A procedure based on generalizability theory is suggested. (GDC)

Different procedures for setting cut points on achievement test scales provide the standard-setting participants with different information to support the unique judgment task associated with each procedure. This study examined how participants in standard settings used the different information from three different procedures in Kentucky in 2000.…

Each state is going to set its own education standards, but unless state leaders talk to each other, there are going to be huge unexplained differences in state performance standards for student achievement. What states say they want their students to be taught is quite similar, but they appear to have very different standards for what students…

This document contains the results of a standard setting conducted in January 2002 on the Delaware Student Testing Program (DSTP) Science and Social Studies tests at grades 4 and 6. Each standard setting process entailed convening four groups, one for each grade level and content area, and each group met for 2 days. At the standard setting judges…

Judgmental standard setting methods, such as the Angoff method (W. Angoff, 1971), use item performance estimates as the basis for determining the minimum passing score (MPS). Therefore the accuracy of these item performance estimates is crucial to the validity of the resulting MPS. Recent researchers (L. Shepard, 1994; J. Impara, 1997) have called…

This study compares the results obtained using the Angoff, borderline group, and contrasting groups methods of determining performance standards. Congruent results were obtained from the Angoff and contrasting groups methods for several test forms. Borderline group standards were not similar to standards obtained with other methods. (Author/PN)

To set a standard on the "beardedness" test (see TM 507 062) the probability that a student with a specific score will be judged as bearded must be estimated for each test score. To get an unbiased estimate of that probability, a representative sample of students at each test score level must be chosen. (BW)

Livingston's (TM 507 218) response to Rowley (TM 507 062) is compared with the original Zieky and Livingston formulation of the Contrasting Groups Method of setting standards. (BW)

Influences on the educational validity of examinations are reviewed. Changes occurring in approaches to standard setting are traced. A view of reliability is presented, with emphasis on assessment of project work, which often involves individual investigation and design by students. A consistency index formula for grading standards is presented.…