The relative validity of adaptive and conventional testing strategies using non-test variables as one set of external criteria was investigated. A total of 101 college students completed both a variable length stradaptive test and peaked conventional test; a second group of 131 college students completed a variable length Bayesian adaptive test…

The Southern Illinois University School of Medicine applies mastery learning concepts to an objectives-based curriculum and uses the Nedelsky method to assess mastery of core objectives. Provisions are made for remediating deficiences. The Nedelsky technique is used for determining an acceptable level of performance in multiple choice examinations…

This study investigated the validity of various approaches to the measurement of English composition skills. Over 600 11th and 12th-grade students were asked to write five 20-minute essays on different topics, to take six objective tests of writing ability, and to do two interlinear exercises. Twenty-five experienced readers assigned scores of…

The report proposes to complete the validation and refinement of a new domain referenced testing technology designed to assess literal comprehension ability in students in grades 1-12. The domain referenced measures in this technology, along with other more traditional measures of reading comprehension, literal and non-literal, are subsequently…

Recent international studies note that countries whose students perform well on international science assessments report the need to change science education. Some countries use assessments for diagnostic purposes to assist teachers in addressing their students' needs. However, in the United States, standards-based reform has focused the national…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.

The English Language Proficiency Test (ELPT) is a multiple-choice examination that is designed to assess the test taker's ability to use English in day-to-day interactions involving listening and reading. It is intended primarily as an admissions and placement test for college students with English as a second language. The ELPT consists of…

Supervisory performance appraisals may be of limited utility in the validation of bilingual tests because incumbents are often hired to be the only employee in a unit who possesses the skills necessary to do the job. In an effort to provide criterion-related validity for four equivalent forms of a Spanish/English bilingual test for school district…

Issues in designing valid tests for the National Assessment of Educational Progress (NAEP) are discussed. Test scores are often provided without any information on the nature of the tasks represented. Because test domains are defined by individual item writers, the generalizability between tests and items is suspect. While typical content…

The purpose of this study was to determine whether option weighting improved the internal consistency and intercorrelation of the subtests. The differential option-weighting scheme employed in this study is based on one devised by Guttman. The tests were first scored with Guttman-type weights and then with conventional correction-for-guessing…

Factor analysis was used to determine whether computerized patient management problems had the same factor structure as multiple choice examinations and rating scales. It was determined that the factor structure was similar to the examinations but not the rating scale. (JKS)

The development and validation of a test of English-as-a-Second-Language (ESL) proficiency are described. The measure is a multiple-choice test based on translation of a literary text from English to Arabic and vice versa. Intended for rapid student placement, it is seen as overcoming most of the defects inherent in traditional translation tests.…

Distractors, the incorrect responses to an item on a multiple-choice test, should be designed to create confusion in the minds of some students and to permit a competent student to be able to see that they are wrong. It is possible, by close scrutiny, to isolate the sources of this confusion and, by looking at a statistical analysis, to find out…

This paper provides a summary of the authors' attempts to uncover links between their measures, classroom mathematics instruction, and student learning. This paper also provides evidence regarding one central critique of their measures: that multiple-choice assessments cannot validly represent the knowledge, skills, and judgment involved in actual…

Essay and multiple-choice scores from Advanced Placement (AP) examinations in American History, European History, English Language and Composition, and Biology were matched with freshman grades in a sample of 32 colleges. Multiple-choice scores from the American History and Biology examinations were superior to essays for predicting overall grade…