This dissertation describes a design for training, in accordance with probability judgment heuristics principles, for the Angoff standard setting method. The new training with instruction, practice, and feedback tailored to the probability judgment heuristics principles was called the Heuristic training and the prevailing Angoff method training…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

University-based teacher education programs and all of their components, including the content disciplines such as mathematics and science, are undergoing an unprecedented degree of scrutiny and challenge. Today, the entire concept of university-based teacher preparation is being questioned, mostly by critics outside the academy, and it is no…

The "No Child Left Behind Act" of 2001 crystallized the concern for accountability in education. National testing was mandated as a way to improve the "broken" educational system. Publicly funded early education programs were not spared from such testing. While the positive effects of high-quality early education on children's…