Testing procedures which involve testees assigning probabilities of correctness to all multiple choice alternatives is examined. Two basic assumptions in these procedures are reviewed. Empirical examinee response data are examined and it is suggested that these assumptions should not be taken lightly in empirical studies of personal probability…

Describes confidence testing methods (confidence weighting, probabilistic marking, multiple alternative selection) as alternative to computer-based, multiple choice tests and explains potential benefits (increased reliability, improved examinee evaluation of alternatives, extended diagnostic information and remediation prescriptions, happier…

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation a linear transformation of the logarithm of the correct response is maximized if the examinee accurately reports his personal probability. To equate…

Effects of immediate and delayed feedback on learning were studied in 2 experiments involving 120 undergraduate students. Subjects answered 90 general information multiple-choice items on 2 different occasions 1 week apart. Subjects rated their confidence in their responses. Results provide support for the Kulhavy and Stock model and the…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation, a linear transformation of the logarithm of the correct response is maximized if the examinee reports accurately his personal probability. To equate…

Instructions are provided on how to create and take computer aided admissible probability measurement (CAAPM) tests using programs available on PLATO IV. Admissible probability measurement is a testing procedure that permits a user to express a degree of uncertainty as to the correctness of alternative answers. Section II describes PLATO IV, an…

In this study, the authors investigated the role of overconfidence on students' performance on multiple-choice examinations. The authors examined the difference between students' self-assessed probability of selecting each correct answer and the proportion of correct answers that they actually selected. Results show that high-performing students…

A student's choice of an answer to a test question is a coarse measure of his knowledge about the subject matter of the question. Much finer measurement might be achieved if the student were asked to estimate, for each possible answer, the probability that it is the correct one. Such a procedure could yield two classes of benefits: (a) students…