It is not unusual for several tests measuring different abilities to be given in one test administration. A common practice is to estimate these abilities independently of each other, but this paper proposes a more efficient method of estimating these abilities that takes into account the correlational structure of the abilities. The method uses a…

The ability estimates of Gibbs sampling and the magnitudes of the posterior standard deviations were investigated. Item parameters of the Q-E intelligence test (J. Fraenkel and N. Wallen, 2000) for 44 examinees were obtained using Gibbs sampling, marginal Bayesian estimation, and BILOG. Two normal priors were used in item parameter estimation.…

This paper suggests several item selection criteria for adaptive testing that are all based on the use of the true posterior. Some of the ability estimators produced by these criteria are discussed and empirically criticized. (SLD)

Imposed a two-level regression model on the ability parameters in an item response theory (IRT) model. Uses a simulation study and an empirical data set to show that the parameters of the two-parameter normal ogive model and the multilevel model can be estimated in a Bayesian framework using Gibbs sampling. (SLD)

A Bayesian procedure to estimate the three-parameter normal ogive model and a generalization to a model with multidimensional ability parameters are discussed. The procedure is a generalization of a procedure by J. Albert (1992) for estimating the two-parameter normal ogive model. The procedure will support multiple samples from multiple…

Used simulations of computerized adaptive tests to evaluate results yielded by four commonly used ability estimation methods: maximum likelihood estimation (MLE) and three Bayesian approaches. Results show clear distinctions between MLE and Bayesian methods. (SLD)

Derives three reliability estimates for the Bayes modal estimate (BME) and the maximum-likelihood estimate (MLE) of theta in computerized adaptive tests (CATs). Computes the three reliability estimates and the true reliabilities of both BME and MLE for seven simulated CATs. Results show the true reliabilities for BME and MLE to be nearly identical…

Relationships between Bayesian ability estimates and the parameters of a normal population distribution are derived in the context of classical test theory. Analogies are provided for use as approximations in work with item response theory (IRT). The following issues are addressed: (1) the relationship between the distribution of the latent…

Hierarchical Bayes procedures for the two-parameter logistic item response model were compared for estimating item and ability parameters through two joint and two marginal Bayesian procedures. Marginal procedures yielded smaller root mean square differences for item and ability, but results for larger sample size and test length were similar.…

Relationships between Bayesian ability estimates and the parameters of a normal population distribution are derived in the context of classical test theory. Formulas are presented for practical work with Bayesian ability estimates, and a numerical illustration is provided. (SLD)

The accuracy of estimation procedures in item response theory was studied using Monte Carlo methods and varying sample size, number of subjects, and distribution of ability parameters for: (1) joint maximum likelihood as implemented in the computer program LOGIST; (2) marginal maximum likelihood; and (3) marginal Bayesian procedures as implemented…

Some alternative criteria for item selection in adaptive testing are proposed that take into account uncertainty in the ability estimates. A simulation study shows that the likelihood weighted information criterion is a good alternative to the maximum information criterion. Another good alternative uses a Bayesian expected a posteriori estimator.…

The asymptotic posterior normality of latent variable distributions is established under very general and appropriate hypotheses, providing a probabilistic basis for assessing ability estimation/prediction accuracy in the long test case, as well as a first step in making the Dutch Identity conjecture rigorous. (SLD)

The precision of the group-based item-response theory (IRT) model applied to school ability estimation is described, assuming use of Bayesian estimation with precision represented by the standard deviation of the posterior distribution. Similarities with and differences between the school-based model and the individual-level IRT are explored. (SLD)

The quality of approximations to first- and second-order moments based on latent ability estimates is discussed. The ability estimates are based on the Rasch or the two-parameter logistic model, and true score theory is used to account for the fact that the basic quantities are estimates. (SLD)