The objective structured practical examination (OSPE) is a reliable assessment of practical skills in anatomy teaching. It is often administered as low-stake assessments to track progress at multiple time points in anatomy curricula. Standard-setting OSPEs to derive a pass mark and to ensure assessment quality and rigor is a complex task. This…

This article provides an overview of the Hofstee standard-setting method and illustrates several situations where the Hofstee method will produce undefined cut scores. The situations where the cut scores will be undefined involve cases where the line segment derived from the Hofstee ratings does not intersect the score distribution curve based on…

California's Commission on Teacher Credentialing (Commission) requires all programs of preliminary multiple and single subject teacher preparation to use a Commission-approved Teaching Performance Assessment (TPA) as one of the program completion requirements for prospective teacher candidates. Three TPA models were approved by the Commission: (1)…

All students deserve to attend programs and institutions that meet high quality standards. But different program goals, investments of time, and eligibility criteria make it difficult to set specific standards that will apply equally well to all types of programs and institutions. This report sets out principles for developing an accountability…

"Classification" and "ranking" are tools for comparing colleges and universities, albeit for different purposes. Although "classification" focuses on identifying similarities rather than ordering institutions, it is closely intertwined with "ranking", whether directly through its content, structure, and…

In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

The Languages Ladder--a new framework for accrediting language proficiency--is a core element of the National Languages Strategy. This paper presents Asset Languages, the system being developed by Cambridge Assessment to implement the Languages Ladder, aiming to set it apart from existing qualification frameworks by accrediting clearly defined…

We look at some of the theoretical and methodological issues underlying international university ranking systems and, in particular, their conceptual connection with the idea of excellence. We then turn to a critical examination of the two best-known international university ranking systems--the "Times Higher Education Supplement (THES)" World…

This article considers some patterns of ranking higher education institutions which are used in the Russian Federation to reveal strengths and weaknesses in meeting the national individual, societal and state-related needs, as well as those of the international academic community concerning relevant information on Russian higher education…

While Objective Structured Clinical Examinations (OSCEs) have become widely used to assess clinical competence at the end of undergraduate medical courses, the method of setting the passing score varies greatly, and there is no agreed best methodology. While there is an assumption that the passing standard at graduation is the same at all medical…

Four different systematic methods for selecting passing scores which differ primarily in the types of judgment they require were compared. The borderline group method and the contrasting groups method were each compared with the Nedelsky method at four schools and the Angoff method at another four schools. The Basic Skills Assessment Tests in…

Comparative results are presented for procedures recently appearing in literature related to standard setting on the National Assessment of Educational Progress--the paper selection method and the contrasting group method. For this comparison, a probabilistic model with normal distribution of performance and a six-point scale were assumed. The…

This paper reports on a newly designed judgmental method for setting test performance standard that: (1) overcome many of the practical and psychometric problems associated with the Angoff and Ebel methods; (2) can be used to set multiple cut points on a score scale; (3) may be readily and efficiently implemented with assessments that use…

Whether common standards exist among the national standards for kindergarten through grade 12 mathematics, science, and civics and government was studied. Common standards were explored among "Curriculum and Evaluation Standards for School Mathematics," produced by the National Council of Teachers of Mathematics, the "National…

This article provides a framework for the rest of the articles in this special issue comparing the utility of three standard-setting methods with complex performance assessments. The context of the standard setting study is described, and the methods are outlined. (SLD)