When one wants to set data reliability standards for a class of scientific inquiries or when one needs to compare and select among many different kinds of data with reliabilities that are crucial to a particular research undertaking, then one needs a single reliability coefficient that is adaptable to all or most situations. Work toward this goal…

A study was conducted to explore empirically the effect of different definitions of the target examinee on the judgment of panelists setting a passing score. Two cut score studies were done in a school district for the same test within a 6-month period, and different definitions of the target candidate were provided for each study. In October…

Results of the fall 1993 administration of part two of the Medical Council of Canada's Evaluating Examination for 744 candidates provided evidence of the consistency of the pass/fail and cutting score definitions for the objective- structured clinical examination stations used across examiners. These results support the validity of this…

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

This article explores issues involved in using assessments as a means of defining standards and encouraging efforts to meet them. It compares the European examination system with the present American testing system. It also considers issues that must be faced in defining learning domains in ways that do not encourage narrowly focused training on…

The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…

The work of the Assessment Development Laboratory (ADL) at the University of Pittsburgh (Pennsylvania) in developing an assessment for identifying accomplished teachers of English language arts to young adolescents (aged 11 to 15 years) for the National Board for Professional Teaching Standards (NBPTS) is reviewed. The assessment is meant to…