The proposition that the optimal number of options in a multiple choice test item is three was examined. The concept of functional distractor, a plausible wrong answer that is negatively discriminating when total test performance is the criterion, is discussed. Three distinct groups of achievers (high, middle, and low) on a national standardized…

This study attempts to establish the ability of a panel of five judges with varied mathematics background to distinguish between two types of mathematical tests by separating their component items when they are presented in a mixed pool of aptitude and achievement tests. Typically, the two tests show high correlation. The judges showed about 70%…

Effects of item arrangement (easy-hard, uniform, and random), test anxiety, and sex on a 48-item multiple-choice mathematics test assembled from items of the American College Testing Program and taken by motivated upper level undergraduates and beginning graduate students were investigated. Four measures of anxiety were used: the Achievement Test…

Gender differences on the National Education Longitudinal Study of 1988 science tests were explored through statistical analyses and interviews with 25 high school students. Results show the importance of studying the validity of the outcome measure and suggest that conclusions about group differences and correlates of achievement depend on the…

The Survey of Testing Practices was administered to 470 undergraduate students at Pepperdine University and the Univesity of California Los Angeles. The items concerned testing practices in three or four classes taken the previous term: type of test, test administration, class size, procedures for returning tests, test difficulty, and observed…

This paper examines the proposed use of student self-report data as proxies for College Basic Academic Subjects Examination (College BASE) scores and as policy indicators of good educational practice. A recent study by the National Center for Higher Education Management Systems had recommended this use of student self-reports. For this study 540…

This paper considers differences in modes of test administration, addressing three questions: (1) Do examinees respond to items in the same way across administration modes and computer interface variations? (2) What are some of the factors that can contribute to modal effects? and (3) Can item parameters calibrated from paper and pencil…

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

The purpose of the paper is to determine whether test forms of the Mathematics Usage Test (AAP Math) of the American College Testing Program are parallel in a multidimensional sense. The AAP Math is an achievement test of mathematics concepts acquired by high school students by the end of their third year. To determine the dimensionality of the…

The issue of parallel forms is of paramount importance for producers of standardized tests. With increasing emphasis being placed on standardized test results it is necessary that each student achieve the same standard score regardless of the form he or she was administered. In the case of the American College Testing (ACT) Assessment Program,…

The oral proficiency interview should be administered infrequently, but there are other measures than can be used between interviews to maintain oral proficiency and achievement as the organizing principles of instruction while placing fewer demands on the teacher/tester. One such measure is a semi-direct procedure that has two steps. First,…

Most seasoned test developers recognize the importance of thoughtful decision making when constructing a test. Unfortunately, many classroom achievement tests are created by novice test developed who have not received sufficient instruction in item writing (G. Gulliksen, 1986; R. J. Stiggins, 1991). The result is often a test that is poorly…

College teachers often use norm-referenced classroom tests which are too easy for distinguishing adequately among levels of student achievement, yet they are reluctant to adopt more difficult tests. We explored the basis for current practices concerning test difficulty through informal interviews and questionnaires completed by faculty members and…

The development of the emerging technology of item writing was motivated in part by the desire to reduce potential subjectivity and bias between different item writers who attempt to construct parallel achievement tests. The present study contrasts four test forms constructed by the combined efforts of six item writers using four methods of item…

The effect on children's test scores of different item formats used in standardized mathematics achievement tests was investigated. In a Utah school, 40 second grade students completed a mathematics computation test using eight different formats derived from five standardized achievement tests. Identical content, taken from the most frequently…