I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

The purpose of this article is to introduce the new "Acoustic Standard for Physical Education Teaching Environments ANSI/ASA S12.60-2019/Part 4" and share the research evidence that formed the basis for developing this physical education-specific standard, provide an overview of how the standard was developed, and offer practical…

The New Education Policy (NEP), 2020, adopted by Government of India, envisages significant and far-reaching reforms in higher education sector in India. In this article, I foreground certain peculiar features of the process of massification of higher education in India, including privatisation and fragmentation. I locate the political economy of…

This paper analyses the psychometric paradigm for understanding educational measurement and standard setting by considering the extent to which that understanding is based on metaphors. I argue that through the metaphors 'more is up' and 'good is up' we spatialise concepts that are not intrinsically spatial. Human abilities form a distinct…

The dialogue on what constitutes quality teacher preparation and how it should be assessed and evaluated is muddled. It begins neatly with a universal agreement and aspiration for quality teaching and enhanced PK-12 student achievement, then quickly scatters when there are attempts to define and weigh key components of academic excellence.…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

The New Zealand Government has announced a change package in response to a recent review of the National Certificates of Educational Achievement (NCEA). In this article, Charles Darr, a chief researcher at the New Zealand Council for Educational Research, outlines several elements of standards-based assessment that can usefully inform NCEA's…

This brief is part of a four-part series examining the past, present, and future of modern school accountability systems. With the dual forces of the COVID-19 pandemic and the national call to action on racial inequity, the question of how we should measure and hold schools accountable for the impact they have on students is more urgent than ever.…

Raters must score accurately and consistently for classroom observation scores to be valid. This requires (a) a standard defining when scoring is accurate and consistent enough and (b) measuring and remediating rater performance against that standard. Current practice has focused on this second problem to the exclusion of the first. My goal here…

This brief examines state-defined long-term goals for improving achievement in states' Every Student Succeeds Act (ESSA) plans as of January 2018, and offers early insights into the varied approaches states have taken in setting long-term goals, timelines, and trajectories to reach their goals.

With a starting point in the tradition of "geisteswissenschaftliche Pädagogik," this article presents a challenge to inclusive education research to engage a Continental perspective on educational research. The motivation is to entice inclusive education researchers to begin to ask educational questions of inclusion, as opposed to…

This contribution outlines the problems and possibilities of three issues with regard to the teaching of L2 interactional competence (IC): (1) specifying IC, (2) standardising IC, and (3) translating conversation analytic (CA) insights into classroom practices. In particular, I argue for a shift of discussion from the conceptually treacherous…

In this paper we describe content focused, practical procedures to establish benchmarked performance standards for educational and other tests. To implement our procedures, we identify one or more external benchmark (e.g., NAEP or PISA performance levels, college and career readiness benchmarks); link to the external benchmarks to locate those…

The 21st century has seen changes in migration patterns in Europe with implications for schooling and civic education: movement from eastern and central European Union member states to western Europe; increased movement between member states for study or work; and growth in the numbers of migrants and refugees seeking asylum in Europe as a result…

While 21st century skills are getting increasing traction in both academia and the professional world, a big challenge today is that there has been no consensus on the unified conceptual framework to define and measure 21st century skills. This consensus is indispensable for understanding, teaching and assessing these skills. Additionally, few…