True-false achievement test items written by typical classroom teachers show about two-thirds of the discrimination of their multiple-choice test items. This is about what should be expected in view of the higher probability of chance success on the true-false items. However, at least half again as many true-false items as multiple-choice items…

The effects of violating four item construction principles were examined to assess the validity of the principles and the importance of students' test wiseness. While flawed items were significantly less difficult than sound items, differences in item discrimination, test reliability, and concurrent validity were not observed. (Author/BW)

This study confirmed the practical benefits of three-choice items. (Author)

Many studies have found that men have a higher level of economic understanding than women. Why such performance differences might matter for practical purposes is discussed. Results of a study which explored whether the gender differences found may be partly a result of the test instruments used are presented. (RM)

Discusses the hypothesis that the difficulty of a multiple-choice comprehension test does not just depend on the difficulty of the text, but rather on the text and the questions. Presents ways to evaluate the difficulty of the text, the questions on it, and the test as a whole. (EKN)

Three item-construction principles for multiple-choice tests were studied to determine how they affected test results for high school students: (1) use of incomplete sentence stem; (2) location of blank in the stem; and (3) presence of noncueing material. Differences in item construction had a slight effect on test results. (Authors/CJ)

The effects of two item formats on item difficulty and item discrimination indices for mathematics problem solving multiple-choice tests were investigated. One format required identifying the proper "set-up" for the item; the other format required complete solving of the item. (Author/JKS)

Multiple choice items formatted as a question with one of four distractors giving the correct answer are a clearer and more valid way of testing the reading comprehension of foreign learners of English than is the common format in which the testee must complete a sentence stem by choosing one of four distractors. (Author/CB)

Studies the statistical validation of a multiple-choice test designed to assess instructional design competency. Compares test results of instructional design professionals, graduate and nongraduate education students, and graduate and nongraduate noneducation students. Results indicate that the test accurately sorted respondents into their…

The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct answer. Multiple-choice testing can lead to unfair…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

Controversy has characterized the research on writing. On the one side are those who state that, to evaluate achievement in writing, evaluate the writing of students. On the other side are those pointing out the problems associated with direct measures of writing such as low reliability and high cost in terms of time and often dollars. The purpose…

The Basic Skills Assessment (BSA) is a national secondary level testing program which provides secure tests in reading, writing, and mathematics. It is designed to identify students who need additional instruction in the basic skills so they may be helped to reach the school district's secondary school graduation requirements. One of the BSA's…