Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

On a multiple-choice test in which each item has k alternative responses, the test taker is permitted to choose any subset which he believes contains the one correct answer. A scoring system is devised. (Author/CTM)

Undergraduate business students completed two multiple-choice tests: one in which they indicated their answer and one of three levels of confidence, and one in which they circled the item only when they possessed high confidence in the answer. The three-level test took longer to take and grade; students preferred the second format. Both types…

Describes confidence testing methods (confidence weighting, probabilistic marking, multiple alternative selection) as alternative to computer-based, multiple choice tests and explains potential benefits (increased reliability, improved examinee evaluation of alternatives, extended diagnostic information and remediation prescriptions, happier…

Confidence scored tests allow subjects to respond to the options on a multiple choice test by assigning probabilities to each of the item options. This paper describes an interactive FORTRAN computer program used for administering, scoring, and interpreting the results of confidence scored tests. (Author/JKS)

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation a linear transformation of the logarithm of the correct response is maximized if the examinee accurately reports his personal probability. To equate…

Binary, probability, and ordinal scoring procedures for multiple-choice items were examined. In two situations, it was found that both the probability and ordinal scoring systems were more reliable than the binary scoring method. (Author/CTM)

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

Multiple-choice testing (MCT) has several advantages which are becoming more relevant in the current financial climate. In particular, they can be machine marked. As an objective testing method it is particularly relevant to engineering and other factual courses, but MCTs are not widely used in engineering because students can benefit from…

Probabilistic testing involves having the examinee assign probabilities to each of the options of a multiple-choice item. These probabilities reflect the student's perception of the correctness of each option. What is presented in the paper is a rationale for probability testing, the current theoretical and empirical findings, and some suggested…

This handbook presents instructions for implementing a confidence testing program in technical training situations, identification of possible areas of application, techniques for evaluating confidence information, advantages and disadvantages of confidence testing, time considerations, and problem areas. Complete instructions for "Pick-One" and…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

The admissable probability measurement (APM) format was used to score a criterion referenced language arts test administered in an inner city junior high school. Its 30 items covered capitalization, punctuation, parts of speech, and sentence analysis. With APM, students indicate their confidence in their answer choice, and guessing is heavily…