The purpose of this study is to describe a new approach for evaluating the judgments of standard-setting panelists within the context of the bookmark procedure. The bookmark procedure is widely used for setting performance standards on high-stakes assessments. A many-faceted Rasch (MFR) model is proposed for evaluating the bookmark judgments of…

Much ado has been made about setting high standards over the past year. Current conversations about creating a common national standard largely focus on the substantive curriculum to be taught at various grade levels. Even more important is each state's expectations for student performance with respect to the curriculum, as expressed through its…

Accountability efforts at California's community colleges gained prominence in the 1990s under an agreement known as Partnership for Excellence (PFE) that involved the chancellor's office, the legislature, and the governor's office. This agreement was the first wide-ranging accountability effort undertaken by the state's community college system.…

The previous issue of "Blueprint" reported significant variability among state standards for education. Such variability means that depending where a student attends school, he might not cover the same material in a course called Algebra I, or Algebra II, or Grade 4, or Grade 6. Many citizens and leaders understand that having a single set of…

In this study, we investigated the changes in physical education programs from 2001 to 2006 based on an analysis of data reported in The Shape of the Nation Report: Status of Physical Education in the USA (National Association for Sport and Physical Education, 2006). Means and standard deviations for numeric variables in the reports were computed,…

This paper examines the Programme for International Student Assessment (PISA), which has become a major and influential component of the Organisation for Economic Cooperation and Development's (OECD) educational work. This measure of comparative performance of educational systems of member and other nations is based on tests commissioned by the…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

Qatar has recently positioned itself to be a leader in education. Central to the country's efforts is the implementation of reforms to its K-12 education system. Central to the reform initiatives was the development of internationally benchmarked curriculum standards in four subjects: Arabic, English as a foreign language, mathematics, and…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

This study examined the relationships between the evaluations obtained from standard setting panelists and changes in ratings between different rounds of a standard setting study that involved setting standards on different language versions of an exam. We investigated panelists' evaluations to determine if their perceptions of the standard…

This issue and the winter 2007-2008 issue (vol. 39, no. 4) of "European Education" address the implications of competition for the future of European higher education. Studies bear on the initiatives taken over the past few years in Europe to enhance the harmonization of European higher education systems and particularly the Bologna…

Purpose: The quality of an education system or a comparative international assessment refers more and more to quantitative parameters, i.e. "educational indicators." The paper aims to analyse the structure of several educational indicators and indicator systems and answer the question "What can educational indicators achieve?"…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This volume lays out the essential arguments for the need for standard setting in educational assessment, discusses standard-setting methods and applications, and reviews current issues in standard setting, including legal challenges. (SLD)

The "Teaching and California's Future" initiative was created a decade ago to strengthen the teaching profession in California. This brief summary is based on the latest research for the initiative, covered in depth in the full report for 2007. The authors argue that California policymakers need to expand their focus from the quantity of…