The goal of teaching philosophy is to develop philosophically literate students and to ensure that students develop philosophical literacy by design and not by chance. Perhaps the best method for teaching philosophy to beginning students is the public model, in which the practice of defending positions in the public arena forces students to become…

The research project reported in this paper had two aims: to demonstrate what standard multiple-choice questions and two new varieties (multiple-choice cloze and guided summary test and to assess whether the new formats test the same skills. To find out what the various question formats test, the study looked at a battery of tests, each of which…

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

This report describes a methodology for increasing the validity and reliability of inferences made about the problem-solving ability of science students that is based on performance on different kinds of tests. The generalizable cognitive components of problem solving that might be targeted by assessment are described, and specifications are…

Procedures for developing and validating a modified cloze test are described. The multiple-choice cloze procedure was developed to aid in the rapid placement of college freshmen who are students of English as a second language. It was designed to overcome some problems in the original cloze test, to reduce anxiety, and to be machine scored. The…

The purpose of this study was to examine the stability of measures of student writing performance across types of discourse (genres) and across response modes (selected response: multiple choice; constructed response: single paragraph, and full length essay). The study addressed the following: (1) the relationship/stability of writing scores…

A project to evaluate Furth's Inventory of Piaget's Developmental Tasks is described, particularly as that test might be useful in adapting instruction and curricula to the cognitive level of science students. This multiple-choice paper-pencil inventory has 72 items in five problem areas: conservation, images, relations, classification, and laws.…

TO ENCOURAGE POLITICAL SCIENCE STUDENTS TO READ PROPERLY AND CONTINUOUSLY, THE AUTHOR GIVES FREQUENT SHORT QUIZZES BASED ON THE ASSIGNED READINGS. FOR EASE IN ADMINISTRATION AND SCORING, HE USES MARK-SENSE CARDS, ON WHICH THE STUDENT MARKS DESIGNATED AREAS TO INDICATE HIS NUMBER AND HIS CHOICE OF ANSWERS. TO EMPHASIZE THE VALUE OF CONTINUED HIGH…

Forty three-option multiple choice (MC) statements on a midterm examination were converted to 120 true-false (TF) statements, identical in content. Test forms (MC and TF) were randomly administered to 50 undergraduates, to investigate the validity and internal consistency reliability of the two forms. A Kuder-Richardson formula 20 reliability was…

The Ohio Trade and Industrial Education Achievement Test battery is comprised of seven basic achievement tests: Machine Trades, Automotive Mechanics, Basic Electricity, Basic Electronics, Mechanical Drafting, Printing, and Sheet Metal. The tests were developed by subject matter committees and specialists in testing and research. The Ohio Trade and…

This report summarizes the development and validation of a test of literal comprehension based on a modified cloze technique. This modification of the cloze offers an objective and partially computerized procedure for constructing items in the multiple-choice format. A field test of the multiple-choice cloze (MCC) involved the administration of 36…

A method for establishing minimal acceptable performance levels for criterion referenced multiple choice examinations is described and two procedures for evaluating its validity are discussed. The method involves assigning a priori item difficulties based on the similarity between the distractor and the correct response. In estimating the validity…

Although the "Don't Know" (DK) option has received telling criticism in maximum performance summative tests, its potential use in formative evaluation was considered and judged to be more promising. The pretest of an instructional module was administered with DK options. Examinees were then required to answer each question to which they had…

Corrected-for-guessing scores on multiple-choice tests depend upon the ability and willingness of examinees to guess when they have some basis for answering, and to avoid guessing when they have no basis. The present study determined the extent to which college students were able and willing to comply with formula-scoring directions. (Author/CTM)

For the training and placement of professional workers, multiple-choice instruments are the norm for wide-scale measurement and evaluation efforts. These instruments contain fundamental problems. Computer-based management simulations may provide solutions to these problems, appear scoreable and reliable, offer increased validity, and are better…