In this paper, we analyse a large, opportunistic dataset of responses (N = 219,826) to online, diagnostic multiple-choice mathematics questions, provided by 6-16-year-old UK school mathematics students (N = 7302). For each response, students were invited to indicate on a 5-point Likert-type scale how confident they were that their response was…

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using…

This paper describes a study conducted with a random sample of 80 student primary teachers drawn from all four years of the Bachelor of Education (BEd) programme at a teacher education institution in Scotland, with a view to determining why there were such differing levels of engagement with an online maths assessment. The assessment was created…

Many institutions encourage formative computer-based assessment (CBA), yet competing priorities mean that learners are necessarily selective about what they engage in. So how can we motivate them to engage? Can we facilitate learners to take more control of shaping their learning experience? To explore this, the Learning with Interactive…

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a…

The purpose of this research was to manipulate the component of confidence found in Keller's ARCS Model to enhance the confidence and performance of undergraduate students enrolled in an online course at a Texas University. This experiment used SAM Office 2003 and WebCT for the delivery of the tactics, strategies, confidence-enhancing e-mails…

Describes confidence testing methods (confidence weighting, probabilistic marking, multiple alternative selection) as alternative to computer-based, multiple choice tests and explains potential benefits (increased reliability, improved examinee evaluation of alternatives, extended diagnostic information and remediation prescriptions, happier…

Describes a computer-based method of confidence-testing, available in batch processing and interactive form, which improves a student's ability to assess probabilities during clinical diagnosis. The methods and results of three experiments are presented. (EAO)

Effects of reviewing items and altering responses on examinee ability estimates, test precision, test information, decision confidence, and pass/fail status were studied for 376 examinees taking 2 certification tests. Test precision is only slightly affected by review, and average information loss can be recovered by addition of one item. (SLD)

Discussion of how computer technology can be integrated into elementary school instruction focuses on evaluating student learning through test scoring. Highlights include descriptions of a computer-based instructional delivery system, modified confidence weighted admissible probability measurement (MCW-APM), and computer-managed instructional…

The level of confidence in pass/fail decisions obtained with computerized adaptive tests and paper-and-pencil tests was greater for 645 medical technology students when the computer adaptive test implemented a 90 percent confidence stopping rule than for paper-and-pencil tests of comparable length. (SLD)

The concept of testing for partial knowledge is considered with the concept of tailored testing. Following the special usage of latent trait theory, the word valdity is used to mean the correlation of a test with the construct the test measures. The concept of a method factor in the test is also considered as a part of the validity. The possible…

Undergraduate students took a multiple choice, computer assisted test and received feedback (items with the correct answers identified) either: (1) immediately, item-by-item; (2) following the entire test; (3) 24 hours later; or (4) no feedback. Retention one to three weeks later was significantly better for delayed feedback, and confidence…