A brief summary of standard setting knowledge is presented, derived from about 20 methods that utilize a judgmental review process, the approach most relevant to the standard-setting strategies proposed in this special issue. Criteria for judging effectiveness and critiques of the methods discussed in the issue are offered. (SLD)

The articles of this special issue propose two methods of deriving an initial standard and one method for determining the extent to which the standard should include compensation. Much work remains to be done on further development of the methods and the larger issues of policy regarding performance assessment. (SLD)

This paper provides a critical analysis of New Zealand's Performance Based Research Fund (PBRF). The first section sketches the development and implementation of the PBRF. The second section evaluates the scheme, concentrating on three themes: the relationship between privatization, competition and research performance; the standardization of…

The three standard-setting approaches described in this special issue are summarized and contrasted: (1) judgmental policy capturing; (2) the extended Angoff method; and (3) the dominant profile method. An integrative summary of findings is followed by recommendations for modifying the methods. (SLD)

This article provides a framework for the rest of the articles in this special issue comparing the utility of three standard-setting methods with complex performance assessments. The context of the standard setting study is described, and the methods are outlined. (SLD)

Performance assessments in education and credentialing are becoming popular. At the same time, there do not exist any well established and validated methods for setting standards on performance assessments. This paper describes several of the new standard-setting methods that are emerging for use with performance assessments and considers their…

A review of educational measurement journals indicates that the decade of the 1970s and up until about 1984 was the time when substantial numbers of studies dealt with criterion-referenced measurement, and the era in which criterion-referenced measurement advances were made. Although there appears to be less interest in publications today, a…