Two years after the first low-cost radio-frequency audience response system using clickers was introduced for college classrooms, at least six different systems are on the market. Their features and user-friendliness are evolving rapidly, driven by competition and improving technology. The proliferation of different systems is putting pressure on…

Quality assurance in medical education is a complex matter. Institutions and external critics of accreditation processes often question the objectivity of peer judgements. Members of accreditation panels similarly often feel at a loss for a lack of mechanisms to help them arrive at a collective assessment of the performance of an institution. In…

Introduction: Heightened concerns about industry influence on continuing medical education (CME) have prompted tighter controls on the management of commercial funding and conflict of interest. As a result, CME providers must closely monitor their activities and intervene if bias or noncompliance with accreditation standards is likely. Potential…

Background/Context: The nationwide preoccupation with accountability continues to grow, with teacher credentialing programs facing growing scrutiny through state-mandated accountability systems. In response to Senate Bill 2042 passed by the California state legislature in 1998, the California Commission for Teacher Credentialing (CCTC) established…

Education in the United States is becoming increasingly standardized, with the standards being initiated at the national level and then trickling down to the state level and finally the local level. Yet, this top-down approach to educational standards carries with it significant limitations, such as loss of local autonomy and restrictions on the…

The "Evaluation of the National Assessment of Educational Progress: Study Reports" describes the special studies that comprised the design of the evaluation. In the Final Report, the authors presented a practical discussion of the evaluation studies to its primary, intended audience, namely policymakers. On this accompanying CD, readers…

Effective school leadership is key to students' academic success. But the development of effective school leadership has been seriously hampered by the lack of technically sound tools to assess and monitor leaders' performance. With support from The Wallace Foundation, a team from Vanderbilt has been developing such an assessment system, and this…

Nebraska, like most states in the U.S., is facing a critical shortage of skilled and employable workers. Business and industry want to grow in Nebraska and realize the road to ensuring success is a workforce possessing updated knowledge and skills that support the use of new technologies, as well as a necessary work ethic to be a dependable and…

While a large body of research has focused on the effects of teachers' educational standards and/or expectations of different types of pupils related to pupils' ability, race/ethnicity, gender, and/or social class, there has been much less research on how such standards/expectations are formed by teachers' institutional structure. Previous…

This research aimed at developing a methodological framework to investigate the alignment of the Lebanese national math exam tests with the curriculum at the middle school level, during the transitory period of a major curricular reform. The focus is on exploring the characteristics of an "assessment culture" set by the national exams…

Using John Kingdon's (2003) multiple streams approach to agenda setting, I analyze how key actors within the state of Wisconsin understood the need to construct and implement the state's No Social Promotion statutes to improve students' academic performance. Policymakers within the state focused their standards-based reforms on the issue of…

This study investigated the intrajudge consistency of Angoff-based item performance estimates. The examination used was a certification examination in an emergency medicine specialty. Ten expert panelists rated the same 24 items twice during an operational standard setting study. Results indicate that the panelists were highly consistent, in terms…

Elements of arbitrariness in the standard setting process are explored, and an alternative to the use of cut scores is presented. The first part of the paper analyzes the use of cut scores in large-scale assessments, discussing three different functions: (1) cut scores define the qualifications used in assessments; (2) they simplify the reporting…

Discussed are nine questions regarding standard setting issues in educational testing: (1) Should normative or content-referenced standards be used? (2) Different standard setting methods yield different results. Does this finding present a problem? (3) Assess the adequacy of the grounding of various methods of standard setting in psychological…

Three studies assessed the psychometric characteristics of the Direct Standard Setting Method (DSSM). The Angoff technique was also used in each study. The DSSM requires judges to consider an examination 10 items at a time and determine the minimum items in that set a candidate should answer correctly to receive the credential. Nine judges set a…