Historically, AP Potential™ has used PSAT/NMSQT® scores to identify students who are likely to earn a 3 or higher on a specific AP® Exam--based on research showing moderate to strong relationships between PSAT/NMSQT scores and AP Exam scores (Camara & Millsap, 1998; Ewing, Camara & Millsap, 2006; Zhang, Patel & Ewing, 2014a). For most…

Over the past decade, the field of teacher professional learning has coalesced around core characteristics of high quality professional development experiences (e.g. Borko, Jacobs, & Koellner, 2010. Contemporary approaches to teacher professional development. In P. L. Peterson, E. Baker, & B. McGaw (Eds.), "International encyclopedia…

Successful coping with academic demands is important given the inverse relationship between stress and positive adjustment in adolescents. The Coping With Academic Demands Scale (CADS) is a new measure of coping appropriate for students pursuing advanced high school curricula, specifically Advanced Placement (AP) classes and the International…

Successful coping with academic demands is important given the inverse relationship between stress and positive adjustment in adolescents. The Coping with Academic Demands Scale (CADS) is a new measure of coping appropriate for students pursuing advanced high school curricula, specifically Advanced Placement (AP) classes and the International…

High school students in accelerated curricula face stressors beyond typical adolescent developmental challenges. The Student Rating of Environmental Stressors Scale (StRESS) is a self-report measure of environmental stressors appropriate for students in Advanced Placement (AP) and International Baccalaureate (IB) courses. We developed the StRESS…

High school students in accelerated curricula face stressors beyond typical adolescent developmental challenges. The Student Rating of Environmental Stressors Scale (StRESS) is a self-report measure of environmental stressors appropriate for students in Advanced Placement (AP) and International Baccalaureate (IB) courses. We developed the StRESS…

The foregoing articles constitute what I consider a comprehensive and clear description of the redesign process of a major assessment. The articles serve to illustrate the problems that will need to be addressed by large-scale assessments in the twenty-first century. Primary among them is how to organize the development of such assessments to meet…

This paper provides an overview of evidence-centered assessment design (ECD) and some general information about of the Advanced Placement (AP[R]) Program. Then the papers in this special issue are discussed, as they relate to the use of ECD in the revision of various AP tests. This paper concludes with some observations about the need to validate…

The cornerstone of evidence-centered assessment design (ECD) is an evidentiary argument that requires that each target of measurement (e.g., learning goal) for an assessment be expressed as a "claim" to be made about an examinee that is relevant to the specific purpose and audience(s) for the assessment. The "observable evidence" required to…

Evidence-centered assessment design (ECD) explicates a transparent evidentiary argument to warrant the inferences we make from student test performance. This article describes how the vehicles for gathering student evidence--task models and test specifications--are developed. Task models, which are the basis for item development, flow directly…

In the last few years, the Advanced Placement (AP) Program[R] has used evidence-centered assessment design (ECD) to articulate the knowledge, skills, and abilities to be taught in the course and measured on the summative exam for four science courses, three history courses, and six world language courses; its application to calculus and English…

In many large-scale assessment programs, achievement level descriptors (ALDs) provide a critical role in communicating what scores on the assessment mean and in interpreting what examinees know and are able to do based on their test performance. Based on their test performance, examinees are often classified into performance categories. The…

This paper discusses issues related to the design and psychometric work for mixed-format tests --tests containing both multiple-choice (MC) and constructed-response (CR) items. The issues of validity, fairness, reliability and score consistency can be addressed but for mixed-format tests there are many decisions to be made and no examination or…

A new test of Advanced Placement Physics, explicitly designed to balance both content and cognitive-processing skills, was developed using Sternberg's theory of successful intelligence. The test was administered to 281 AP Physics students from 10 schools during the 2006-2007 school year. Six empirically distinguishable profiles of strengths and…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.