Two new methods for improving the measurement precision of a general test factor are proposed and evaluated. One new method provides a multidimensional item response theory estimate obtained from conventional administrations of multiple-choice test items that span general and nuisance dimensions. The other method chooses items adaptively to…

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

Literature related to the multiple true-false (MTF) item format is reviewed. Each answer cluster of a MTF item may have several true items and the correctness of each is judged independently. MTF tests appear efficient and reliable, although they are a bit harder than multiple choice items for examinees. (SLD)

Analyses based on fitting item response models to data from the College Board's Advanced Placement exams in Chemistry and United States History indicated that the constructed-response portion of the tests yielded little information over and above that provided by the multiple-choice sections. These tests also allow examinees to select subsets of…

This study examined the relationship of multiple-choice and free-response items contained on the College Board's Advanced Placement Computer Science (APCS) examination. Subjects were two samples of 1,000 randomly drawn from the population of 7,372 high school students taking the 1988 examination of the APCS "AB" form. Most were high…

Issues of the relative costs of multiple choice tests and alternative types of assessment are explored. Before alternative assessments in large-scale or small-scale programs are used, attention must be given to cost considerations and the resources required to develop and implement the assessment. Major categories of cost to be considered are…

The admissable probability measurement (APM) format was used to score a criterion referenced language arts test administered in an inner city junior high school. Its 30 items covered capitalization, punctuation, parts of speech, and sentence analysis. With APM, students indicate their confidence in their answer choice, and guessing is heavily…

At the root of the performance assessment movement is fairly widespread dissatisfaction with high-stakes multiple-choice tests. Many critics of multiple-choice tests argue that to improve instruction, tests themselves will have to improve. Hundreds of schools around the country are already experimenting with performance assessments, and many…

This handbook is a guide to the "Test Development Notebook" of the System for Pupil and Program Evaluation and Development (SPPED). It describes the contents and organization of the notebook, suggests various uses of the exercises, provides sample test designs, outlines test production procedures, and offers guidelines for score…

The Secondary Level English Proficiency (SLEP) test is a measure of ability in understanding spoken and written English. It is designed for use with students entering grades 7 through 12 whose native language is other than English. Previously offered on a limited basis at test centers established by the Educational Testing Service, the SLEP is now…

The Ohio Sixth-grade Proficiency Tests are designed to measure a sixth-grade level of literacy and basic competence. Beginning in March 1996, Ohio sixth graders will take proficiency tests in writing, reading, mathematics, citizenship, and science. Both teachers and administrators have been involved in the test development process, establishing…

Under Title V, Guidance, Counseling, and Testing of the "National Defense Education Act of 1958," the Congress of the United States has recognized the value of tests as a tool which may be used to help make an early determination of the aptitudes and abilities of the students in U.S. schools. This bulletin attempts to explain the use and…