Eleven judges representing 11 different geographic regions in the United States participated in a standard-setting session designed to determine the possibility of obtaining interjudge consensus and intrajudge consistency simultaneously. Each judge had experience in the field for which standards were being set. The judges rated 65 multiple-choice…

This grade 12 Diploma Examination for Alberta (Canada) Social Studies 30 booklet is divided in two parts. Part A consists of 70 multiple-choice questions worth 70 percent of the total score. Part B consists of the written response section worth 30 percent of the total. The student must choose one of two topics for the essay. The essay scores are…

The purpose of this bulletin is to provide information about the Alberta (Canada) Grade 3 Social Studies Achievement Test. The Bulletin includes a general description of the Achievement Testing Program, a description of the Grade 3 Social Studies Achievement Test, an outline of the objectives to be tested, and the test blueprint. Student…

Student knowledge in a subject area prior to and after instruction has traditionally been assessed by administering a pre- and post-test, usually multiple choice, though recent studies criticize the use of even the best-constructed multiple choice tests. This study assessed college freshmen's knowledge before and after a laboratory experience in…

In this paper 45 item-writing rules for multiple-choice tests presented in textbooks on educational measurement in a previous study are identified. The current study presents a quantitative review of the literature with respect to the empirical and theoretical evaluation of these principles of item-writing. Fifty-six studies that addressed at…

The bulletin provides a general description of the Grade 9 Social Studies Achievement Test, an outline of the objectives to be tested, the test blueprint, test scoring procedures, and sample questions that demonstrate the nature and complexity of the test items. All test questions are drawn from the content of three prescribed topics: selected…

Compiled by the Wisconsin Association of Academic Librarians' (WAAL) Education and Library Use Committee, the Test of Minimum Library Use Skills provides examples of questions which may be used to assess students' knowledge of the 13 minimum library use skills adapted by the WAAL membership in 1983. The 59 multiple choice questions that make up…

The usefulness of before-adjunct questions with standardized multiple-choice tests in increasing reading comprehension scores was studied by examining the relative effectiveness of reading test questions first or reading the passage first. Subjects were 210 fourth graders randomly assigned to two treatment groups. The Level 9 Reading Comprehension…

The item difficulty and item discrimination of three multiple-choice item formats were compared in experimental and non-experimental settings. In the experimental study, 104 graduate students were randomly assigned to complete one of three forms of a multiple-choice test: (1) a complex alternative ("none of the above") as the correct answer; (2) a…

The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

This study compared the item difficulty and item discrimination of three multiple choice item formats. The multiple choice formats studied were: a complex alternative (none of the above) as the correct answer; a complex alternative as a foil, and the one-correct answer format. One hundred four graduate students were randomly assigned to complete…

In order to evaluate our methods and approaches of estimating the operating characteristics of discrete item responses, it is necessary to try other comparable methods on similar sets of data. LOGIST 5 was taken up for this reason, and was tried upon the hypothetical test items, which follow the normal ogive model and were used frequently in…

Optimal appropriateness indices, recently introduced by Levine and Drasgow (1984), provide the highest rates of detection of aberrant response patterns that can be obtained from item responses. These optimal appropriateness indices are used to study three important problems in appropriateness measurement. First, the maximum detection rates of two…

On well-constructed multiple-choice tests, the most serious threat to measurement is not variation in item discrimination, but the guessing behavior that may be adopted by some students. Ways of ameliorating the effects of guessing are discussed, especially for problems in latent trait models. A new item response model, including an item parameter…