The current study expands on previous research on gender differences and similarities in science test scores. Using three different approaches -- differential item functioning, differential distractor functioning, and decision tree analysis -- we examine a high school science assessment administered to 3,849 10th-12th graders, of whom 2,021 are…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

An index identifying factors leading to unusual response patterns by students, the modified caution index, was computed for the reading comprehension and study skills items of Booklet 5 from the 1979 National Assessment of Educational Progress (NAEP) reading achievement survey given to the 9-, 13- and 17-year-old samples. The analyses focused on…

Techniques to identify the degree to which a response pattern is unusual and the pattern's relationship to examinee background are presented. Sato's caution index and modified caution index use clusters of items for comparisons of observed performance outcomes and do not require the use of item response theory. Correlation between the indices was…