In this report we explore the role of reviewer agreement in judgments about alignment between tests and standards. Specifically, we consider approaches to describing alignment that incorporate reviewer agreement information in different ways. The essential questions were whether and how taking into account reviewer agreement changes the picture of…

The aim of this study was to assess test takers' attitudes and beliefs about an admissions test used extensively in graduate schools of business in the United States, the Graduate Management Admission Test (GMAT), and the relationships of these attitudes and beliefs to test performance. A set of attitude and belief items was administered by…

During the past decade the relationship of self-regulated learning (SRL) to academic success has been extensively explored but the impact of metacognition in this process has not been thoroughly examined. This study examined the relationship of metacognitive knowledge monitoring (MKM) to classroom performance. Eighty-four undergraduate students in…

The present study examined whether specific item characteristics, such as mode of acquisition (MoA) of word meanings, make reading comprehension tests particularly difficult for deaf children. Reading comprehension data on nearly 13,000 hearing 7-to-12-year-olds and 253 deaf 7-to-20-year-olds were analyzed, divided across test levels from second…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.

Alternative mathematical items administered as prototypes at the spring 1989 Field Trials of the Scholastic Aptitude Test (SAT) are evaluated for differential item functioning (DIF) and differential speededness. Results for Algebra Placement (AP) and Student Produced Response (SPR) items are presented and contrasted with results obtained on two…

Beginning in 1972, the average Scholastic Aptitude Test Verbal (SAT-V) score for men has been higher than that for women. This study created a detailed history of the content of SAT-V sections over the last two and a half decades and examined the changes of test content and trends over time in the balance of references to and representations of…

The National Assessment of Educational Progress (NAEP) is one part of a comprehensive assessment system that is evolving in the United States. In the view of the NAEP Technical Subgroup for the National Education Goals Panel, the NAEP should be an independent, statistically rigorous longitudinal measure of educational attainment in the essential…

The American College Testing Program is developing a new program, Work Keys, a system to develop and assess employability skills. It consists of four components: (1) a systematic process for profiling job skill requirements; (2) assessments that measure learners' job skill levels; (3) procedures and formats for conveying assessment results so they…

This document contains a brief overview and introduction to the Urban District Assessment Consortium (UDAC), sample performance items with student responses, and sample open-ended items with student responses. The UDAC is a multiyear cooperative effort that is comprised of 11 major urban school districts across the United States and the Center for…

In 1986, the Florida State Legislature passed a law requiring teachers to demonstrate knowledge of their subject areas before being granted teacher certification. The state also provided funding for developing subject area examinations. The generic procedures for developing these examinations are outlined. During the first phase of the project, an…

This digest discusses how well authentic mathematics assessment tests can be expected to meet the needs of mathematics instruction that focuses on conceptual insights and analytical skills. In the new mathematics curriculum, situational lessons or real-life problems attempt to include dimensions of thinking and reasoning, individual or small-group…

A study investigated the usefulness of adopting innovative, student-centered instructional techniques in two traditional but very different cultures, Turkey and Puerto Rico. In each country, the study occurred in a program to train teachers of English as a Second Language (ESL). Using a student-centered approach, trainees learned how to prepare…

The instructor's guide and curriculum guide contained in this packet are designed to help teachers provide future automotive technicians with some of the electronic skills they will need to service cars of the future. The instructor's guide is designed to help teachers make certain that each student gets the most benefit possible out of both the…

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…