This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

Developing a cognitive model of task performance is an important and often overlooked phase in assessment design; failing to establish such a model can threaten the validity of the inferences made from the scores produced by an assessment (e.g., Leighton, 2004). Conducting think aloud interviews (TAIs), where students think aloud while completing…

This is a keynote presentation given at AERA on developing a validity agenda for growth models in a large scale (e.g., state) setting. The emphasis of this presentation was to indicate that growth models and the validity agenda designed to provide evidence in supporting the claims to be made need to be personalized to meet the local or…

Presented at the national conference for the American Educational Research Association (AERA) in April 2009. This study examined the utility of scores on the SAT writing test, specifically examining the reliability of scores using generalizability and item response theories. The study also provides an overview of current predictive validity…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.

Presented at the College Board National Forum in Washington, D.C., October 2010. This presentation examines the recent national validity evidence that supports the use of SAT Writing in college admissions and English placement. Additionally it includes information on the College Board's free online Admitted Class Evaluation Service (ACES) system,…

[Slides] presented at the annual conference of the Southern Association for College Admission Counseling, April 2010. This presentation summarizes recent research from the national SAT Validity Study and includes information on the Admitted Class Evaluation Service (ACES) system and how ACES can help institutions conduct their own validity…

This document reviews 49 assessment measures that were designed for, or could be used with, pre-school children between the ages of three and five. The assessments have been classified into the following categories: (1) cognitive skills, (2) language, (3) social adjustment and behavior, (4) physical skills, (5) developmental and clinical measures,…

This publication is designed to help vocational evaluators wisely select and use tests within the context of the referral questions and the individualized evaluation plan. The first of two parts contains information on why tests are used in evaluation, problems with tests, and how to select tests. Part 2 contains a review of specific tests that…

Presented at the College Board Western Regional Office (WRO) Forum in San Diego in February 2009. This presentation explores SAT test validity and how it can be used to inform both advisement and placement at the national or institution level. Institutional validity can be measured using the Admitted Class Evaluation Service (ACES) which schools…

Discusses classical test theory, including test construction, administration, and use. Covers basic statistical concepts in measurement, reliability, and validity; principles of sound test construction and item analysis; test administration and scoring; procedures for transforming raw test data into scaled scores; and future prospects in test…

The current study will explore the validity and potential of using the SAT, in conjunction with HSGPA, to arrive at a predicted FYGPA to improve student retention at four-year postsecondary institutions. Specifically, this study examined whether college students who did not perform as expected (observed FYGPA minus predicted FYGPA) were more…

Presented at the 23rd Annual Historically Black Colleges & Universities (HBCU) Conference in Atlanta, GA, in September 2011. Admitted Class Evaluation Service (ACES) is the College Board's free online service that predicts how admitted students will perform at a college or university generally, and how successful students will be in specific…

This compilation lists 286 current second language testing research projects in the United States and abroad. Each listing provides the name of the principal investigator, address, title of project, areas covered by the research, and a 50- to 100-word descriptive statement of the project. Date of completion or projected completion of each project…

Provides a brief overview of validity and reliability as concepts related to the overall quality of test instruments. Describes the nature and interpretation of content, face, criterion, and construct validity and identifies several approaches for measurement and improvement of reliability. (Author/CS)