In theoretical models of self-regulated learning, calibration is one important component in successful learning. Two issues of calibration are explored. First, Nelson (1987) suggested the "G" (gamma) coefficient is the most appropriate measure of calibration (judgment accuracy) and rejected signal detection theory's "d'"…

In this paper, we report on a study to quantify the impact on student learning and on student assessment literacy of a brief assessment literacy intervention. We first define "assessment literacy" then report on the development and validation of an assessment literacy measurement instrument. Using a pseudo-experimental design, we…

Using published findings and by further analyses of existing data, the structure, validity and utility of the Academic Behavioural Confidence scale (ABC) is critically considered. Validity is primarily assessed through the scale's relationship with other existing scales as well as by looking for predicted differences. The utility of the ABC scale…

In a confidence weighting situation, the examinee is asked to indicate the correct answer, and how certain he or she is of the correctness of that answer. This paper reviews the bases for confidence marking, its validity and accuracy in evaluating students, and it's use in research. (BW)

Multiple-choice testing (MCT) has several advantages which are becoming more relevant in the current financial climate. In particular, they can be machine marked. As an objective testing method it is particularly relevant to engineering and other factual courses, but MCTs are not widely used in engineering because students can benefit from…

Effects of reviewing items and altering responses on examinee ability estimates, test precision, test information, decision confidence, and pass/fail status were studied for 376 examinees taking 2 certification tests. Test precision is only slightly affected by review, and average information loss can be recovered by addition of one item. (SLD)

This study examined multiple choice testing for formative and summative evaluation among sixth-grade inner-city students (N=568) who were assessed simultaneously, with forced choice and information based (confidence weighted) test scoring formats. Results are discussed, with emphasis on implications for teacher evaluation of low-achieving…

The feasibility and the cost-effectiveness of using confidence testing as a diagnostic aid in technical training programs were studied. Two types of confidence testing, Pick-One and Distribute 100 Points, were developed for comparison to conventional multiple-choice testing. The criteria for feasibility included end of block examination grades,…