The effect that student ability level has on receiving feedback following classroom tests was studied. Forty-four undergraduates enrolled in four educational psychology classes were assigned to low or high ability groups based on their total score from the first four exams. Two classes were trained in a feedback technique, and the remaining two…

A study examined the effect of headings and adjunct questions embedded in an expository test on the delayed multiple-choice test performance of 88 undergraduate students enrolled in psychology courses. The subject of the passage read by the students was the settling of Anglo America; the subheadings in the passage listed names of major subtopics…

The proposition that the optimal number of options in a multiple choice test item is three was examined. The concept of functional distractor, a plausible wrong answer that is negatively discriminating when total test performance is the criterion, is discussed. Three distinct groups of achievers (high, middle, and low) on a national standardized…

This manual describes and explains the commands available in the ITEMBANK package (a comprehensive test item bank). True-false, multiple-choice, short-answer, and essay items, as well as the associated answers, can be accommodated. Content domains and behavior categories exist for item classification. Most menus have instant action. Items and…

The effects of presenting test items in random order or in a sequence parallel to the order of presentation were studied by testing 92 undergraduates in an introductory psychology course at Emporia State University (Kansas). Two test forms, sequential (S) and random (R), of multiple-choice questions were prepared for four 1-hour examinations…

This Wisconsin state test booklet contains 110 multiple choice questions that measure civic literacy. The questions require knowledge of: (1) the U.S. Constitution, the Bill of Rights, and the Declaration of Independence; (2) the three branches of the U.S. government; (3) the structure of Wisconsin's government; (4) U.S. political parties and…

Procedures for correcting for guessing and for assessing partial knowledge (correction-for-guessing, three-decision scoring, elimination/inclusion scoring, and confidence or probabilistic scoring) are discussed. Mean scores and internal consistency reliability estimates were compared across three administration and scoring procedures for…

In this report, selection theory is used as a theoretical framework from which mathematical algorithms for tailored testing are derived. The process of tailored, or adaptive, testing is presented as analogous to personnel selection and rejection on a series of continuous variables that are related to ability. Proceeding from a single common-factor…

A schema-based technique designed to improve students' use of feedback on their performance on classroom tests was partially tested. Subjects were 16 female undergraduates separated into two groups based on grade point average (GPA). The training program required that one class meeting after each classroom exam be used as a feedback session. A…

The reliability, validity, and score discrepancies of 94 expository essays scored in conference versus remote settings were studied. Focus was on comparing holistic ratings obtained in both settings. Essays written by college freshmen on two different topics were scored by readers working in a conference setting and by different readers working in…

Techniques to enable high school students to improve their test performance are briefly outlined. The techniques cover pre-test preparation, strategies for use during test administration, and special skills for multiple-choice and essay tests. An advantage of students practicing their test-taking skills is that it will help them manage the anxiety…

A total of 50 college students enrolled in different sections of a language arts methodology course served as treatment and control groups to investigate the effects of student-generated questions on test performance. Periodically throughout the course, students in the treatment group received instruction in effective questioning techniques by…

This report investigates an area of uncertainty in using the Angoff method for setting standards, namely whether or not a judge's conceptualizations of borderline group performance are realistic. Ratings are usually made with reference to the performance of this hypothetical group, therefore the Angoff method's success is dependent on this point.…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

Hauptschule (practical secondary school) pupils are more readily confused than Gymnasium (university-preparatory secondary school) pupils when confronted with false answers. Spelling tests should be designed with regard to the type of school. Introducing visual guides helps the Hauptschule pupils to better achievement in productive tests. (Text is…