This study addressed the impact that undergraduate teacher education programs have on preservice educators, and upon the quality of education that urban-minority school communities receive. The problem is that variances exist among the standards used for undergraduate teacher education programs with specific regard to culturally responsive…

The dialogue on what constitutes quality teacher preparation and how it should be assessed and evaluated is muddled. It begins neatly with a universal agreement and aspiration for quality teaching and enhanced PK-12 student achievement, then quickly scatters when there are attempts to define and weigh key components of academic excellence.…

The ambitious goals of standards-based reform call for both technical and adaptive leadership to address problems of practice involving the technical and adaptive alignment of teachers' instruction to the standards. Thus, standards-aligned curriculum implementation necessitates both types of strategies; otherwise, adaptive challenges will persist.…

This article conceptualises the relationship between exam board insider research and the policy-making context in which they operate. Exam board researchers are constrained by commercial and political interests in disclosing their knowledge. and face pressures in disseminating research, but also find themselves working in contexts where calls to…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

The objective structured practical examination (OSPE) is a reliable assessment of practical skills in anatomy teaching. It is often administered as low-stake assessments to track progress at multiple time points in anatomy curricula. Standard-setting OSPEs to derive a pass mark and to ensure assessment quality and rigor is a complex task. This…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

Sign languages present particular challenges to language assessors in relation to variation in signs, weakly defined citation forms, and a general lack of standard-setting work even in long-established measures of productive sign proficiency. The present article addresses and explores these issues via a mixed-methods study of a human-rated…

Childhood trauma is an all-too common factor in the lives of students and their families. Schools and communities across America are more likely to serve families that have experienced trauma (Anderson, 2016). Although trauma or toxic episodes can impact families across the economic spectrum, children living in poverty, in socially isolated areas,…

The New Zealand Government has announced a change package in response to a recent review of the National Certificates of Educational Achievement (NCEA). In this article, Charles Darr, a chief researcher at the New Zealand Council for Educational Research, outlines several elements of standards-based assessment that can usefully inform NCEA's…

Setting performance standards is a judgmental process involving human opinions and values as well as technical and empirical considerations. Although all cut score decisions are by nature somewhat arbitrary, they should not be capricious. Judges selected for standard-setting panels should have the proper qualifications to make the judgments asked…

In this study, we present the development of individualized feedback for a large-scale listening assessment by combining standard setting and cognitive diagnostic assessment (CDA) approaches. We used the performance data from 3,358 students' item-level responses to a field test of a national EFL test primarily intended for tertiary-level EFL…

This paper investigates what matters to medical domain experts when setting standards on a language for specific purposes (LSP) English proficiency test: the Occupational English Test's (OET) writing sub-test. The study explores what standard-setting participants value when making performance judgements about test candidates' writing responses,…

Seldom have comparative studies of educational assessment systems been undertaken, especially regarding their standard setting procedures. This study examines the effects of governance structures on the power relations in standard setting in the dominant school-leaving or university-entrance examinations. We present acritical analysis of the…

This brief is part of a four-part series examining the past, present, and future of modern school accountability systems. With the dual forces of the COVID-19 pandemic and the national call to action on racial inequity, the question of how we should measure and hold schools accountable for the impact they have on students is more urgent than ever.…