This study compares the results obtained using the Angoff, borderline group, and contrasting groups methods of determining performance standards. Congruent results were obtained from the Angoff and contrasting groups methods for several test forms. Borderline group standards were not similar to standards obtained with other methods. (Author/PN)

The Languages Ladder--a new framework for accrediting language proficiency--is a core element of the National Languages Strategy. This paper presents Asset Languages, the system being developed by Cambridge Assessment to implement the Languages Ladder, aiming to set it apart from existing qualification frameworks by accrediting clearly defined…

Results suggest that different groups of judges do set similar examination standards when using the same procedure, and that the average of individual judgments does not differ significantly from group consensus judgments. Significant differences were found, however, between the standards set by the two procedures employed. (RC)

Compared the Nedelsky (L. Nedelsky, 1954) and Angoff (W. Angoff, 1971) standard-setting methods in three studies involving 80 graduate students as judges. Nedelsky cutscores were significantly lower than Angoff cutscores. Suggests that combining the strong features of both methods would make a better standard-setting procedure. (SLD)

We look at some of the theoretical and methodological issues underlying international university ranking systems and, in particular, their conceptual connection with the idea of excellence. We then turn to a critical examination of the two best-known international university ranking systems--the "Times Higher Education Supplement (THES)" World…

With the exception of the procedures developed by Porter and colleagues (Porter, 2002), other methods of defining and measuring alignment are essentially limited to alignment between tests and standards. Porter's procedures have been generalized to investigating the alignment between content standards, tests, textbooks, and even classroom…

A group-process approach to standard setting was compared to an independent approach for a medical specialty certification examination. Both approaches used the Angoff (1971) standard-setting method. In the group-process method, reviewers discussed items and their ratings during the rating process; in the independent condition, reviewers provided…

This paper represents an abridgement of a panel session that reported on the status of training for archivists in the use of Encoded Archival Description (EAD) in seven countries (France, Germany, Netherlands, Portugal, Switzerland, United Kingdom, and United States). It touched on related archival descriptive standards and practices and…

This article considers some patterns of ranking higher education institutions which are used in the Russian Federation to reveal strengths and weaknesses in meeting the national individual, societal and state-related needs, as well as those of the international academic community concerning relevant information on Russian higher education…

Two years after the first low-cost radio-frequency audience response system using clickers was introduced for college classrooms, at least six different systems are on the market. Their features and user-friendliness are evolving rapidly, driven by competition and improving technology. The proliferation of different systems is putting pressure on…

To determine if a given standard-setting procedure will yield consistent evaluation outcomes, one of three parallel certifying examinations was administered to three classes of second year medical students. The results indicated that the standard-setting procedure is a significant factor in the determination of the evaluation outcome. (Author/BW)

When setting standards, administrators of small-scale OSCEs often face several challenges, including a lack of resources, a lack of available expertise in statistics, and difficulty in recruiting judges. The Modified Borderline-Group Method is a standard setting procedure that compensates for these challenges by using physician examiners and is…

Whether differences in the standards states have set can be explained by something other than regional differences is explored. In addition, a way in which standards can be compared is defined, and the standard of proficiency that seems to be widely shared across the country is illustrated. The Trial State Assessment (TSA) data from the National…

This paper presents a comparison of two commonly used methods, Angoff (W. Angoff, 1971) and Bookmark (D. Lewis, H. Mitzel, and D. Green, 1996), for setting cut scores on selected response tests. This comparison is presented through an application to a grade 7 mathematics assessment in a suburban Midwestern school district. Training and operational…

The major forms of evidence that support a standard's credibility are reviewed, and what can be done over time and for different forms of an examination to enhance its comparability in a credentialing setting is outlined. Pass-fail decisions must be consistent to ensure a standard's credibility. (SLD)