Proposes a mixture item response model for investigating individual differences in the selection of response categories in multiple choice items. A real data example illustrates how the model can be used to distinguish examinees disproportionately attracted to different types of distractors, and a simulation study evaluates item parameter recovery…

Examines the relation between question characteristics and awareness of comprehension. Finds that readers have great confidence that their answers to thematic questions in both short-answer and multiple-choice formats are correct, even when they were wrong. Suggests that readers of challenging, inconsiderate texts are unaware of gross…

Presuming that test scores can accurately reflect educational quality is naive and potentially dangerous. Sophisticated statistical procedures cannot fully separate the effects of confounding background variables (ethnicity, language proficiency, or poverty) from test scores. A broad-based assessment model relying on multiple indices and…

An item response model for multiple-choice items is described and illustrated in item analysis. The model provides parametric and graphical summaries of the performance of each alternative associated with a multiple-choice item. The illustrative application of the model involves a pilot test of mathematics achievement items. (TJH)

Multilinear formula scoring (MFS) is reviewed, with emphasis on estimating option characteristic curves (OCSs). MFS was used to estimate OCSs for the arithmetic reasoning subtest of the Armed Services Vocational Aptitude Battery for 2,978 examinees. A second analysis obtained OCSs for simulated data. The use of MFS is discussed. (SLD)

Simulation techniques were used to generate conventional test responses and track the proportion of alternatives examinees could classify independently before and after taking the test. Finite-state scores were compared with these actual values and with number-correct and formula scores. Finite-state scores proved useful. (TJH)

Offers 20 multiple choice questions to test the reader's knowledge of characteristics of the ERIC online database. The levels of expertise indicated by scores obtained on the quiz are given and suggested further readings are provided. (CLB)

The author studied whether students' preferences for a particular exam format were a function of past performances. He reviews the literature and reports on administration of a questionnaire to 90 accounting students. Results indicate that students prefer problem-solving exams to multiple choice, regardless of past performances. (CH)

Two theorems of unidimensional item response theory are extended to describe observable item response distributions when there is conditional independence between but not necessarily within item bundles. An item bundle is a small group of multiple-choice items sharing a common reading passage or a group of items sharing distractors. (SLD)

Using the generalized partial-credit item response theory (IRT) model, polytomous items from the 1991 field test of the National Assessment of Educational Progress reading test were calibrated with multiple-choice and open-ended items. Polytomous items provide more information than dichotomous items. (SLD)

This study investigated the validity of having English-as-a-Second-Language test-takers select from a checklist the strategies they believe they use when answering multiple choice reading comprehension questions. Results suggest that the self-report checklist discussed above exercised to an unknown extent an instrument effect on the readers who…

Discusses the advantages of using multiple choice questions, highlighting the flexibility of using different variations of questions. Item writing guidelines include information on content, sensitivity, difficulty, irrelevant sources of difficulty, order, misleads, avoidance of clues, and exercises in the application of guidelines. (JKP)

Argues that multiple-choice tests can be effective only if the items are written in a format suitable for testing the mastery of specific instructional objectives. Proposes the use of nonrestrictive test items and cites examples of such items. (FL)

Two item-writing rules were tested: phrasing stems as questions versus partial sentences; and using the "none-of-the-above" option instead of a specific content option. Results with 228 college students do not support the use of either stem type and provide limited evidence to caution against the "none-of-the-above" option.…

Discusses a concurrent validity study of an indirect measure of English-as-a-Second-Language writing based on information processing: anagram solving, word reordering, paragraph assembly tests, etc. The criterion measure was a direct, holistic measure of writing. Analysis revealed that the indirect measure did not exhibit concurrent validity for…