Establishing cut scores using the Angoff method requires panelists to evaluate every item on a test and make a probability judgment. This can be time-consuming when there are large numbers of items on the test. Previous research using resampling studies suggest that it is possible to recommend stable Angoff-based cut score estimates using a…

Using S. J. Messick's theoretical work concerning construct validity as a guide, underlying hypotheses for investigation when validating placement test decisions are assessed. Guidelines on validating placement decisions are offered, and the hypotheses and guidelines are applied in a validation study of the Written English Expression Placement…

The influence of judges' knowledge on standard setting for competency tests was studied with 17 judges who took an economics teacher certification test while setting competency standards using the Angoff procedure. Judges tended to set higher standards for items they answered correctly and lower standards for items they answered incorrectly. (SLD)

Six papers on the use of partial credit item response theory score models in applied measurement settings are presented. These applications include the scoring of medical certification examinations using computer-based patient simulations, narrative writing tests, and educational diagnosis. (TJH)

The modified caution index's use in identifying judges whose patterns of item judgment appear aberrant when compared with the pattern produced by the entire group (N=158) of judges was studied. Effects on test standards and passing rates of removing test standards of these judges were also assessed. (TJH)

Number-correct scoring was compared to empirical option weighting for estimating domain scores and making pass/fail decisions that are typical of certification, licensing, competency, and proficiency testing. The usefulness of the option-total correlation option-weighting method was illustrated with a sample of 1,000 high school students. (SLD)

Responses of 310 teachers in Florida to a survey about use of teacher-made tests, nationally standardized tests, and state minimum competency tests were studied. Results show that all three test types were used to some extent in eight decision categories, but none of the tests were clearly dominant. (SLD)

A panel of 24 public school teachers and 37 college/university faculty members provided recommendations on minimal standards for the essay portion of the National Teacher Examinations Communication Skills Test. Public school judges' recommendations were significantly more variable than were those of college/university judges. (TJH)