This study examines how passage availability and reading comprehension question format (open-ended vs. multiple-choice) influence question answering. In two experiments, college undergraduates read an expository passage and answered open-ended and multiple-choice versions of text-based, local, and global bridging inference questions. Half the…

Background: Quality mental health care for adults with an intellectual disability (ID) depends upon the availability of appropriately trained and experienced psychiatrists. There have been few surveys of psychiatrists working with this population. Method: This Australian study obtained psychiatrists' attitudes to and perceptions of the mental…

Although the belief has been expressed that performance assessments are intrinsically more fair than multiple-choice measures, some forms of performance assessment may in fact be more likely than conventional tests to tap construct-irrelevant factors. As performance assessment grows in popularity, it will be increasingly important to monitor the…

Effects of blind guessing on the success of passing true-false and multiple-choice tests are investigated under a stochastic binomial model. Critical values of guessing are thresholds which signify when the effect of guessing is negligible. By checking a table of critical values assembled in this paper, one can make a decision with 95% confidence…

Free-response (FR) item formats, such as essay questions, are popular in educational assessment. The criticisms against FR items are that they are more expensive to score, take up more testing time, provide less content coverage, and are less reliable than multiple-choice (MC) items. For these reasons, FR items are often combined with MC items.…

The traditional indicator of test speededness, missing responses, clearly indicates a lack of time to respond (thereby indicating the speededness of the test), but it is inadequate for evaluating speededness in a multiple-choice test scored as number correct, and it underestimates test speededness. Conventional item response theory (IRT) parameter…

A study was conducted to determine to what extent college teacher-made multiple-choice tests contain test-wiseness clues that can be used to identify correct answers. A sample of 43 undergraduate teacher-made examinations was obtained from two colleges and three universities. The sample included midterm and final examinations and quizzes. The…

The technique of nonmetric multidimensional scaling (MDS) was applied to real item response data obtained from a multiple-choice achievement test of unknown dimensionality. The goal was to classify the 50 items into the various subtests from which they were drawn originally, the latter being unknown to the investigator. Issues addressed in the…

Describes a study of the validity of a multiple-choice test intended to pinpoint the manner in which a concept is misunderstood. (BR)

Following a discussion of the pros and cons of multiple choice tests, concludes that they are a valid means of determining literary knowledge. (RB)

This document reviews studies that investigated certain inadequacies of English as a Second Language (ESL) reading comprehension tests. The first study examined whether three ESL reading comprehension tests required information principally from the text or from background knowledge. Results indicated that background knowledge differentially…

This study applied one-parameter latent trait measurement theory to investigate the measurement characteristics of both forms of a multiple-choice measure of field-independence--the Finding Embedded Figures Test (FEFT). The FEFT has a multiple-choice format that may facilitate administration and scoring in comparison with use of supply-format…

A study was undertaken to develop a checklist of desirable characteristics of mail questionnaires. The checklist was to reflect some degree of consensus among experts in survey research and to be used as a general guide by novice questionnaire designers. A second objective was to take a first step toward development of an objective measure of…