I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

There is always a chance that examinees will answer multiple choice (MC) items correctly by guessing. Design choices in some modern exams have created situations where guessing at random through the full exam--rather than only for a subset of items where the examinee does not know the answer--can be an effective strategy to pass the exam. This…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

The UK educational assessment landscape is changing, characterised by attempts to create more flexible pathways through learning. This has led to attempts to formalise the comparative relationships between different general and vocational qualifications. The National Qualifications Framework (NQF), the Framework for Achievement and the Framework…

Influences on the educational validity of examinations are reviewed. Changes occurring in approaches to standard setting are traced. A view of reliability is presented, with emphasis on assessment of project work, which often involves individual investigation and design by students. A consistency index formula for grading standards is presented.…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

The concept of performance levels in criterion-referenced assessment is explored by applying the idea to different types of tests commonly used in schools, mastery tests (including diagnostic tests) and achievement tests. In mastery tests, a threshold performance standard must be established for each criterion. Attainment of this threshold…

This is the sixth and final report of the National Research Council's Committee on the Performance of Military Personnel on the Joint-Service Job Performance Measurement/Enlistment Standards (JPM) Project, a project designed to develop measures of performance for entry-level military jobs so that enlistment standards could be linked to performance…

Lessons derived from the Job Performance Measurement (JPM) Project, which is overseen by the Office of the Assistant Secretary of Defense for Force Management and Personnel, for educational assessment are explored. The JPM Project was initiated to develop high fidelity measures of performance on the job that can be used to evaluate personnel…

The "No Child Left Behind Act" of 2001 crystallized the concern for accountability in education. National testing was mandated as a way to improve the "broken" educational system. Publicly funded early education programs were not spared from such testing. While the positive effects of high-quality early education on children's…

"Educational Measurement" has been the bible in its field since the first edition was published by ACE in 1951. The importance of this fourth edition of "Educational Measurement" is to extensively update and extend the topics treated in the previous three editions. As such, the fourth edition documents progress in the field and…