Personalized assessments are of increasing interest because of their potential to lead to more equitable decisions about the examinees. However, one obstacle to the widespread use of personalized assessments is the lack of a measurement toolkit that can be used to analyze data from these assessments. This article takes one step toward building…

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

Developing a cognitive model of task performance is an important and often overlooked phase in assessment design; failing to establish such a model can threaten the validity of the inferences made from the scores produced by an assessment (e.g., Leighton, 2004). Conducting think aloud interviews (TAIs), where students think aloud while completing…

With an annual yearly growth rate of 9.3 percent over the last two decades, Advanced Placement courses have become a juggernaut in American high school education. AP courses are routinely perceived as an indicator of educational rigor, and many schools push to enroll low-income or minority students in these courses in the hope of preparing them…

This paper discusses issues related to the design and psychometric work for mixed-format tests --tests containing both multiple-choice (MC) and constructed-response (CR) items. The issues of validity, fairness, reliability and score consistency can be addressed but for mixed-format tests there are many decisions to be made and no examination or…

This study evaluates the effects of the Advanced Placement (AP) Program in the lives of students and investigates the validity of the Advanced Placement Examinations at participating colleges and universities. Nine of the colleges and universities that received the most AP candidates in 1982 were selected for the study. The transcripts of a large…

Reports on a study validating the new (1980) Advanced Placement English Language and Composition Examination. Shows that the study demonstrates the rigor of the new exam. (RL)

Compares performance of first-year general chemistry college students from 32 institutions with performance of Advanced Placement (AP) Chemistry Candidates in 1978 to provide a concurrent validity measure of the multiple-choice section of the AP chemistry examination. Average AP candidates scored significantly higher than average college students.…

Because foreign language placement at the University of Illinois at Urbana-Champaign is based solely on College Entrance Examination Board Foreign Language Placement Test scores, first semester courses are composed of students with heterogeneous foreign language backgrounds. French 101 was chosen to study the relationship between two entering…