Knowledge assessments in undergraduate mathematics education commonly evaluate response correctness to determine learner proficiency. However, simultaneous evaluation of learner metacognition more accurately assesses the multiple dimensions of knowledge and has been shown to increase assessment validity and reliability. Research into…

Contradictory results have been reported regarding the accuracy of various methods used to assess student learning in higher education. The current study examined student learning outcomes across a multi-section and mult-iinstructor psychology research course with both indirect and direct assessments in a sample of 67 undergraduate students. The…

We introduce a specific type of item for knowledge tests, confidence-weighted true-false (CTF) items, and review experiences of its application in psychology courses. A CTF item is a statement about the learning content to which students respond whether the statement is true or false, and they rate their confidence level. Previous studies using…

How do people monitor the correctness of their answers? A self-consistency model is proposed for the process underlying confidence judgments and their accuracy. In answering a 2-alternative question, participants are assumed to retrieve a sample of representations of the question and base their confidence on the consistency with which the chosen…

Instructional strategies for teaching concepts have long been identified. Less commonly studied is a learner's level of confidence and certitude in their knowledge based upon exposure to these instructional treatments. This experimental research study used an instrument referred to as the Spatial Probability Measure (SPM) to solicit levels of…

Possible differences in rater confidence were investigated among raters whose primary role with the ratee was either professorial or administrative or that of an employer. As hypothesized, significant differences were found among the groups and among types of performance rated. (LBH)

Multiple-choice testing (MCT) has several advantages which are becoming more relevant in the current financial climate. In particular, they can be machine marked. As an objective testing method it is particularly relevant to engineering and other factual courses, but MCTs are not widely used in engineering because students can benefit from…

Presents a discussion of trying to best account for the variation resulting from guessing on a multiple-choice exam. A mathematical process is given to determine the amount of variance that could be added or subtracted from a student's score to account for guessing. Examples are provided. (MVL)

Training evaluation and student achievement measurement literature is reviewed with primary emphasis placed on studies reported in the last 10 years. Recent trends in training evaluation and student achievement measurement are presented. Factors relating to this topic, such as statistical methods, course development methods, training techniques,…