Linking score scales across different tests is considered speculative and fraught, even at the aggregate level. We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that aggregate linkages can be validated both…

Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This paper introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

In "Updating the Duplex Design for Test-Based Accountability in the Twenty-First Century," Bejar and Graf (2010) propose extensions to the duplex design for large-scale assessment presented in Bock and Mislevy (1988). Examining the range of people who use assessment results--from students, teachers, administrators, curriculum designers,…

This article describes a Mapmark standard setting procedure, developed under contract with the National Assessment Governing Board (NAGB). The procedure enhances the bookmark method with spatially representative item maps, holistic feedback, and an emphasis on independent judgment. A rationale for these enhancements, and the bookmark method, is…

Several complex sample standard error estimators based on linearization and resampling for the latent regression model of the National Assessment of Educational Progress (NAEP) are studied with respect to design choices such as number of items, number of regressors, and the efficiency of the sample. This paper provides an evaluation of the extent…

The National Center for Education Statistics (NCES) continues to be interested in addressing the issue identified by the Government Accountability Office (GAO). With the release of the 2009 National Assessment of Educational Progress (NAEP) reading and mathematics assessments, NCES again had the opportunity to measure the status and change in…

This report summarizes the in-school field operations and data collection activities, as well as the administration decision-making, undertaken in Year 11 of the National Assessment of Educational Progress, (NAEP) from March, 1979 through July, 1980. The more pertinent summary data on the planning and conduct of Year 11 in-school assessment are…

Sampling activities for Year 11 of the National Assessment of Educational Progress began in 1977 when plans were begun to Years 11-14. In March 1979 the sample was selected and allocated. In-school secondary sample selection activities were carried out during May through August, 1979, and in-school package assignment and field support activities…

In an attempt to increase the usefulness of future National Assessment of Educational Progress (NAEP) findings, yet retain the usefulness of past assessments, a framework for the conduct of assessments is presented. This framework is supported by agreement on three major goals, by overall methods for reaching those goals, and by firm concepts of…

Although various assessments differ in notable ways, they often follow a plan that is thoroughly tested and features four basic steps: (1) selecting learning areas and identifying their objectives; (2) developing achievement test items to determine the degree to which these objectives are accomplished; (3) administering the test items to…

This report presents the conceptual framework and major features of the new design for the National Assessment of Educational Progress (NAEP) as conducted by Educational Testing Service beginning July 1983. It comprises three major chapters. The first chapter reviews the social and environmental changes that demand reconsideration of NAEP. The new…