Evidence-centered design (ECD) is an orientation towards assessment development. It differs from conventional practice in several ways and consists of multiple activities. Each of these activities results in a set of useful documentation: domain analysis, domain modeling, construction of the assessment framework, and assessment…

With an annual yearly growth rate of 9.3 percent over the last two decades, Advanced Placement courses have become a juggernaut in American high school education. AP courses are routinely perceived as an indicator of educational rigor, and many schools push to enroll low-income or minority students in these courses in the hope of preparing them…

In this study, we describe a framework for monitoring rater performance over time. We present several statistical indices to identify raters whose standards drift and explain how to use those indices operationally. To illustrate the use of the framework, we analyzed rating data from the 2002 Advanced Placement English Literature and Composition…

A new test of Advanced Placement Physics, explicitly designed to balance both content and cognitive-processing skills, was developed using Sternberg's theory of successful intelligence. The test was administered to 281 AP Physics students from 10 schools during the 2006-2007 school year. Six empirically distinguishable profiles of strengths and…

The Des Moines Public School System (Iowa) continually evaluates the process of teaching for learning. As part of this ongoing process, this report provides information to the Board of Directors and the public about the achievement of district students on the Iowa Tests of Basic Skills (ITBS), Iowa Tests of Educational Development (ITED), the…

Establishing and refining a framework for performance assessment is especially difficult in large-scale settings that can involve hundreds of judges and thousands of students. This presentation advocates the interactive use of two complementary analytic perspectives and illustrates the approach in the context of the College Entrance Examination…

Six cases are studied to give some idea of the range of performance assessments in use in the United States. Contrast and comparison are made possible through the study of the following: (1) the South Brunswick (New Jersey) Public Schools Observational Portfolio for kindergarten through grade 12; (2) the Arizona Student Assessment Program (not yet…