Comparative Judgement (CJ) aims to improve the quality of performance-based assessments by letting multiple assessors judge pairs of performances. CJ is generally associated with high levels of reliability, but there is also a large variation in reliability between assessments. This study investigates which assessment characteristics influence the…

Argues that selecting data according to expected information gain, as proposed by M. Oaksford and N. Chater (1994, 1996), leads to suboptimal performance in Bayesian hypothesis testing. Procedures are presented that are better justified normatively, their psychological implications are explored, and a number of novel predictions are derived under…

Argues that Klauer's proposal (1999) and proposal presented are equally well justified from a normative perspective and that, where the predictions of the two approaches diverge, the existing empirical evidence is consistent with the information gain approach. Recommends that more empirical research is required to decide between these two…

Olae is a computer system for assessing student knowledge of physics, and Newtonian mechanics in particular, using performance data collected while students solve complex problems. Although originally designed as a stand-alone system, it has also been used as part of the Andes intelligent tutoring system. Like many other performance assessment…