This investigation seeks to determine: the validity and reliability of cloze tests for measuring reading comprehension; the relation of cloze scores to difficulty levels of reading passages; the relation of cloze test performance to length of English training; and the merits of judgmental vs. random word deletion in test construction. (DB)

Responses to a sample test were simulated for examinees under free-response and multiple-choice formats. Test score sets were correlated with randomly generated sets of unit-normal measures. The extent of superiority of free response tests was sufficiently small so that other considerations might justifiably dictate format choice. (Author/DWH)

Outlines the benefits associated with true-false and multiple-choice tests and sets forth rules for writing effective items for such tests. (FL)

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

This report describes a methodology for increasing the validity and reliability of inferences made about the problem-solving ability of science students that is based on performance on different kinds of tests. The generalizable cognitive components of problem solving that might be targeted by assessment are described, and specifications are…

Procedures for developing and validating a modified cloze test are described. The multiple-choice cloze procedure was developed to aid in the rapid placement of college freshmen who are students of English as a second language. It was designed to overcome some problems in the original cloze test, to reduce anxiety, and to be machine scored. The…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

A project to evaluate Furth's Inventory of Piaget's Developmental Tasks is described, particularly as that test might be useful in adapting instruction and curricula to the cognitive level of science students. This multiple-choice paper-pencil inventory has 72 items in five problem areas: conservation, images, relations, classification, and laws.…

Forty three-option multiple choice (MC) statements on a midterm examination were converted to 120 true-false (TF) statements, identical in content. Test forms (MC and TF) were randomly administered to 50 undergraduates, to investigate the validity and internal consistency reliability of the two forms. A Kuder-Richardson formula 20 reliability was…

The Ohio Trade and Industrial Education Achievement Test battery is comprised of seven basic achievement tests: Machine Trades, Automotive Mechanics, Basic Electricity, Basic Electronics, Mechanical Drafting, Printing, and Sheet Metal. The tests were developed by subject matter committees and specialists in testing and research. The Ohio Trade and…

A novel scoring procedure was investigated in order to obtain scores from a conventional multiple-choice test that would be free of the guessing component or contain a known guessing component even though examinees were permitted to guess at will. Scores computed with the experimental procedure are based not only on the number of items answered…

This report summarizes the development and validation of a test of literal comprehension based on a modified cloze technique. This modification of the cloze offers an objective and partially computerized procedure for constructing items in the multiple-choice format. A field test of the multiple-choice cloze (MCC) involved the administration of 36…

Although the "Don't Know" (DK) option has received telling criticism in maximum performance summative tests, its potential use in formative evaluation was considered and judged to be more promising. The pretest of an instructional module was administered with DK options. Examinees were then required to answer each question to which they had…

A procedure is described for increasing the reliability of tests after they have been given and for developing shorter but more reliable tests. Eight tests administered to 200 graduate students studying educational research are analyzed. The analysis considers the original tests, the items loading on the first factor of the test, and the items…

Corrected-for-guessing scores on multiple-choice tests depend upon the ability and willingness of examinees to guess when they have some basis for answering, and to avoid guessing when they have no basis. The present study determined the extent to which college students were able and willing to comply with formula-scoring directions. (Author/CTM)