I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

The GEM Centre provides technical support to the United Nations Educational, Scientific and Cultural Organization (UNESCO) Institute for Statistics (UIS), which has been mandated to monitor the progress of countries towards achieving the education goals of Sustainable Development Goal 4 (SDG 4). The International Standard Setting Exercise (ISSE)…

This paper analyses the psychometric paradigm for understanding educational measurement and standard setting by considering the extent to which that understanding is based on metaphors. I argue that through the metaphors 'more is up' and 'good is up' we spatialise concepts that are not intrinsically spatial. Human abilities form a distinct…

This report provides a resource for state and district assessment staff as they develop requests for proposals (RFPs) for interim assessments for all of their students, including those who require accessibility features, to demonstrate their knowledge and skills as well as those who may need an alternate assessment because of their significant…

The redesigned "TOEIC Bridge"® tests are designed to measure the reading, listening, speaking, and writing proficiency of beginning to low-intermediate English learners in the context of everyday adult life. This report describes the comprehensive and multifaceted process used to enhance the meaningfulness of TOEIC Bridge test score…

Seldom have comparative studies of educational assessment systems been undertaken, especially regarding their standard setting procedures. This study examines the effects of governance structures on the power relations in standard setting in the dominant school-leaving or university-entrance examinations. We present acritical analysis of the…

Changes to the American Board of Internal Medicine's Maintenance of Certification Program: Preserving Core Assessment Values As Maintenance of Certification (MoC) for practicing physicians has evolved into more continuous programs, controversy has arisen over how physicians should self-regulate their profession and serve the public trust in doing…

While 21st century skills are getting increasing traction in both academia and the professional world, a big challenge today is that there has been no consensus on the unified conceptual framework to define and measure 21st century skills. This consensus is indispensable for understanding, teaching and assessing these skills. Additionally, few…

This case study provides an account of my experiences and lessons learned in designing and implementing a survey research. The research was part of my doctoral thesis in educational measurement and quantitative methods. The purpose of the study was to examine the effectiveness of a Completely Structured Training compared with Partially Structured…