Nearly all of the research on standard setting focuses on different standard setting methods rather than the interaction of group members and the instructions given to group members. This study explored the effect of deliberation style and the requirement to reach consensus on the passing score, on rater satisfaction, and on postdecision…

The kernel of the Angoff method of standard setting (W. Angoff, 1971) would seem to be the judgment of whether a minimally competent person could answer an item on a test correctly or not. So it would seem that any procedure that requires independent judgment of the correctness or incorrectness of a response to items for a minimally acceptable…

Judgmental standard setting approaches rely on the perceptions of experts about examinee performance on a test. Traditional standard setting methods ask panelists to estimate how well a randomly selected hypothetical examinee who is representative of a well-defined target group, usually a minimally competent candidate (MCC), will perform on each…

Whether the measurement profession should consider developing and adopting a code of professional conduct is explored after a brief review of existing references to standards of conduct and a review of other professional codes. Issues include the need for a code of ethics, its usefulness, and its enforcement. (SLD)

Examines criteria for choosing between test-centered and examinee-centered methods of standard setting in empirical terms and in terms of whether the method is consistent with the model of achievement underlying test design and interpretation and the assessment methods being used. Contains 35 references. (Author/SLD)

One year before the National Education Summit, Congress had reauthorized the National Assessment of Educational Progress (NAEP) and created a National Assessment Governing Board to develop and oversee policy for the NAEP. In conjunction with the call to establish national education goals, efforts are being made to establish standards for…

Some of the different approaches to standard setting are discussed. Brief comments and references are offered concerning strategies that rely primarily on the use of expert judgment. Controversy surrounds methods that use expert judges, as well as those using test groups to set scores empirically. A minimax procedure developed by H. Huynh, an…

In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

To set a standard on the "beardedness" test (see TM 507 062) the probability that a student with a specific score will be judged as bearded must be estimated for each test score. To get an unbiased estimate of that probability, a representative sample of students at each test score level must be chosen. (BW)

Livingston's (TM 507 218) response to Rowley (TM 507 062) is compared with the original Zieky and Livingston formulation of the Contrasting Groups Method of setting standards. (BW)

This article considers the methods and difficulties of establishing, sharing and applying assessment standards within module teams working in a business school. Against a background of increasing reliance on explicit knowledge to establish standards in the HE sector the study looks at ways in which staff within module teams attempted to reach a…

Schulz (2006) provides a different perspective on standard setting than that provided in Reckase (2006). He also suggests a modification to the bookmark procedure and some alternative models for errors in panelists' judgments than those provided by Reckase. This article provides a response to some of the points made by Schulz and reports some…

The Languages Ladder--a new framework for accrediting language proficiency--is a core element of the National Languages Strategy. This paper presents Asset Languages, the system being developed by Cambridge Assessment to implement the Languages Ladder, aiming to set it apart from existing qualification frameworks by accrediting clearly defined…

"The Program Evaluation Standards," established by 16 professional associations, identify evaluation principles that should result in improved program evaluations that address utility, propriety, feasibility, and accuracy. This digest summarizes these standards. Guidelines and illustrative cases to assist in meeting these standards are…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…