This paper describes an empirical evaluation of a Bayesian procedure for equating scores on test forms taken by small numbers of examinees, using collateral information from the equating of other test forms. In this procedure, a separate Bayesian estimate is derived for the equated score at each raw-score level, making it unnecessary to specify a…

The threshold utility model for culture-fair selection is defined for both quota-free and for restricted selection. In addition a full Bayesian solution based on posterior predictive distributions is provided. Mathematical derivations and an example are provided. (JKS)

Reports an error in "Finding Useful Questions: On Bayesian Diagnosticity, Probability, Impact, and Information Gain" by Jonathan D. Nelson (Psychological Review, 2005[Oct], Vol 112[4], 979-999). In Table 13, the data should indicate that 7% of females had short hair and 93% of females had long hair. The calculations and discussion in the article…

In this study, the authors assess several strategies created on the basis of the Mantel-Haenszel (MH) procedure for conducting differential item functioning (DIF) analysis with small samples. One of the analytical strategies is a loss function (LF) that uses empirical Bayes Mantel-Haenszel estimators, whereas the other strategies use the classical…

In general, candidates selected for employment will probably perform worse than estimated. Bayesian statistical methods may be useful in adjusting the estimates. (Author)

The use of some very simple loss or utility functions in educational evaluation has recently been advocated by Gross and Su, Petersen and Novick, and Petersen. This paper demonstrates that more realistic utility functions can easily be used and may be preferable in some applications. (Author/CTM)

Statistical procedures based on Bayesian estimation for obtaining estimates of a propensity (which would include estimates of proportions or relative frequencies) are described for the special case where the observer can only note whether the propensity exceeds or does not exceed a constant between 0 and 1. (JKS)

The use of Bayes' estimates for proportions in the Law of Comparative Judgment is suggested to avoid sample proportions of zero and one. (Author)

This article describes an illustration of Bayesian inference that has proved popular with students.

A specific application of a general paradigm described by R. D. Cook (1986) and R. McCulloch (1985) in assessing local influence is given. Snow geese flock size is estimated as "X" by an observer and "Y" by a photograph. "Y" is believed to be the true flock size. The problem is to obtain true flock size "Z"…

The purpose of this paper is to demonstrate in detail how the Empirical Bayes (EB) statistical estimation strategy can be applied to an important class of educational research contexts. EB methods are tailored specifically to the analysis of data with a hierarchical structure. For instance, investigators may be interested in discovering how…

Two new methods for constructing a credibility interval (CI)--an interval containing a specified proportion of true validity description--are discussed, from a frequentist perspective. Tolerance intervals, unlike the current method of constructing the CI, have performance characteristics across repeated applications and may be useful in validity…

Several norms for how people should assess a question's usefulness have been proposed, notably Bayesian diagnosticity, information gain (mutual information), Kullback-Liebler distance, probability gain (error minimization), and impact (absolute change). Several probabilistic models of previous experiments on categorization, covariation assessment,…