I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

In the Bookmark standard-setting procedure, panelists are instructed to consider what examinees know rather than what they might attain by guessing; however, because examinees sometimes do guess, the procedure includes a correction for guessing. Like other corrections for guessing, the Bookmark's correction assumes that examinees either know the…

The purpose of this article is to introduce the new "Acoustic Standard for Physical Education Teaching Environments ANSI/ASA S12.60-2019/Part 4" and share the research evidence that formed the basis for developing this physical education-specific standard, provide an overview of how the standard was developed, and offer practical…

The New Education Policy (NEP), 2020, adopted by Government of India, envisages significant and far-reaching reforms in higher education sector in India. In this article, I foreground certain peculiar features of the process of massification of higher education in India, including privatisation and fragmentation. I locate the political economy of…

This paper analyses the psychometric paradigm for understanding educational measurement and standard setting by considering the extent to which that understanding is based on metaphors. I argue that through the metaphors 'more is up' and 'good is up' we spatialise concepts that are not intrinsically spatial. Human abilities form a distinct…

Standard setting is arguably one of the most subjective techniques in test development and psychometrics. The decisions when scores are compared to standards, however, are arguably the most consequential outcomes of testing. Providing licensure to practice in a profession has high stake consequences for the public. Denying graduation or forcing…

The dialogue on what constitutes quality teacher preparation and how it should be assessed and evaluated is muddled. It begins neatly with a universal agreement and aspiration for quality teaching and enhanced PK-12 student achievement, then quickly scatters when there are attempts to define and weigh key components of academic excellence.…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

The New Zealand Government has announced a change package in response to a recent review of the National Certificates of Educational Achievement (NCEA). In this article, Charles Darr, a chief researcher at the New Zealand Council for Educational Research, outlines several elements of standards-based assessment that can usefully inform NCEA's…

This brief is part of a four-part series examining the past, present, and future of modern school accountability systems. With the dual forces of the COVID-19 pandemic and the national call to action on racial inequity, the question of how we should measure and hold schools accountable for the impact they have on students is more urgent than ever.…

Raters must score accurately and consistently for classroom observation scores to be valid. This requires (a) a standard defining when scoring is accurate and consistent enough and (b) measuring and remediating rater performance against that standard. Current practice has focused on this second problem to the exclusion of the first. My goal here…

This brief examines state-defined long-term goals for improving achievement in states' Every Student Succeeds Act (ESSA) plans as of January 2018, and offers early insights into the varied approaches states have taken in setting long-term goals, timelines, and trajectories to reach their goals.

With a starting point in the tradition of "geisteswissenschaftliche Pädagogik," this article presents a challenge to inclusive education research to engage a Continental perspective on educational research. The motivation is to entice inclusive education researchers to begin to ask educational questions of inclusion, as opposed to…

This contribution outlines the problems and possibilities of three issues with regard to the teaching of L2 interactional competence (IC): (1) specifying IC, (2) standardising IC, and (3) translating conversation analytic (CA) insights into classroom practices. In particular, I argue for a shift of discussion from the conceptually treacherous…

In this paper we describe content focused, practical procedures to establish benchmarked performance standards for educational and other tests. To implement our procedures, we identify one or more external benchmark (e.g., NAEP or PISA performance levels, college and career readiness benchmarks); link to the external benchmarks to locate those…