Maximum likelihood and Bayesian ability estimation in multidimensional item response models can lead to paradoxical results as proven by Hooker, Finkelman, and Schwartzman ("Psychometrika" 74(3): 419-442, 2009): Changing a correct response on one item into an incorrect response may produce a higher ability estimate in one dimension.…

In this paper, optimal designs will be derived for estimating the ability parameters of the Rasch model when difficulty parameters are known. It is well established that a design is locally D-optimal if the ability and difficulty coincide. But locally optimal designs require that the ability parameters to be estimated are known. To attenuate this…

Multinomial processing tree models are widely used in many areas of psychology. A hierarchical extension of the model class is proposed, using a multivariate normal distribution of person-level parameters with the mean and covariance matrix to be estimated from the data. The hierarchical model allows one to take variability between persons into…

Statistical procedures based on Bayesian estimation for obtaining estimates of a propensity (which would include estimates of proportions or relative frequencies) are described for the special case where the observer can only note whether the propensity exceeds or does not exceed a constant between 0 and 1. (JKS)

A proportional reduction in loss (PRL) measure for reliability of categorical data is explored for the situation in which each of "N" judges assigns a subject to one of "K" categories. Calculating a lower bound for reliability under more general conditions than had been proposed is demonstrated. (SLD)

This paper develops theory and methods for the application of the Bayesian Model II method to the estimation of binomial proportions and demonstrates its application to educational data. (Author/RK)

Educational assessment concerns inference about student knowledge, skills, and accomplishments. Test theory has evolved in part to address questions of weight, coverage, and import of data. Resulting concepts and techniques can be viewed as applications of more general principles for inference in the presence of uncertainty. (SLD)