Examined intra- and inter-rater consistency of item performance estimated from an Angoff standard setting over 2 years, with 29 panelists one year, and 30 the next. Results provide evidence that item performance estimates were consistent within and across panels within and across years. Factors that might have influenced this high degree of…

This article reviews the empirical literature on 9 topics about the modified Angoff standard-setting method that have been studied repeatedly in the literature, while taking into consideration the methodological warrant for the findings on the topics. It concludes that we can be reasonably confident about selecting the appropriate number of judges…

The annual meeting of the ENQA (European Association for Quality Assurance in Higher Education) IQA (internal quality assurance) Group gathered some 60 participants in the premises of the Accreditation Organisation of the Netherlands and Flanders (NVAO) in The Hague in June 2009. This seminar was a successful follow-up to the first ENQA IQA…

Purpose: The quality of an education system or a comparative international assessment refers more and more to quantitative parameters, i.e. "educational indicators." The paper aims to analyse the structure of several educational indicators and indicator systems and answer the question "What can educational indicators achieve?"…

The National Association for Sport and Physical Education (NASPE) is an advocate for having highly qualified physical education teachers deliver developmentally appropriate, standards-based instruction in schools. However, a comprehensive definition of what constitutes a highly qualified physical education teacher did not exist until recently.…

This study examined chief student affairs officer (CSAO) titles at 2,621 4-year public and private institutions and 2-year institutions included in the 2006 Higher Education Directory. This study replicated and extended Rickard's (1985a) study of CSAO titles, with regard to institutional autonomy and professional standardization and provides a…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This article reports on the professional development of teacher educators within the context of a national project, "Professional Quality of Teacher Educators," where a professional standard and a standards-based procedure of (self-)assessment and professional development have been created and effectively implemented. This project…

Many approaches to standard-setting use item calibration and student score estimation results to structure panelists' tasks. However, this requires collecting standard-setting judgments after the item analysis results are available. The Scoring Guide Alignment approach collects standard-setting judgments during the scoring sessions from teachers…

Current Council for Accreditation of Counseling and Related Educational Programs (CACREP; 2001) standards promote the use of triadic supervision by counselor educators and supervisors. However, conceptual models of triadic supervision do not presently exist in the supervision literature. This article describes the process and structure of 1 model…

In the Angoff standard setting procedure, subject matter experts (SMEs) estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item comprising the test. In many cases, these item performance estimates are made twice, with information shared with SMEs between estimates. This…

This publication provides information relating to Arizona Academic Standards for Grade 8. The following standards are reviewed: (1) the arts standards; (2) comprehensive health standards; (3) foreign and native language standards; (4) reading standard articulated by grade level 2003; (5) writing standard articulated by grade level 2004; (6)…

This volume lays out the essential arguments for the need for standard setting in educational assessment, discusses standard-setting methods and applications, and reviews current issues in standard setting, including legal challenges. (SLD)

Describes how a new approach to setting standards for colleges, the Academic Quality Improvement Project, follows principles from manufacturing and industry. (EV)

Uses several thought experiments to explore the potential impact of the choice of criterion on the results of examinee-centered studies. Conclusions from these experiments are then used to examine the different cutting scores from several contrasting groups studies on the National Assessment of Educational Progress. (SLD)