False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

The feasibility of using a distance measure, called the Bayesian distance, for automatic sequential document classification was studied. Results indicate that, by observing the variation of this distance measure as keywords are extracted sequentially from a document, the occurrence of noisy keywords may be detected. This property of the distance…

The past few decades have been an era of rapid growth and expansion for university and research libraries, yet their standards of library services have declined. Specifically, more people more often cannot get the information they seek from the library. The main factors in this decline in service are the rapidly increasing numbers both of volumes…

To facilitate meta-analysis of diverse study findings, a mixed linear model with fixed random effects is presented and illustrated with data from teacher expectancy experiments. The standardized effect size is viewed as random and the variation among effect sizes is modeled as a function of study characteristics. (Author/BS).

This paper explores the application of a technique for hierarchical item response theory (IRT) calibration of complex constructed response tasks that has promise both as a calibration tool and as a means of evaluating the isomorphic equivalence of complex constructed response tasks. Isomorphic tasks are explicitly and rigorously designed to be…

Simple Bayesian approaches can be applied to answer specific questions in evaluating an individualized reading program. A small reading and study skills program located in the counseling center of a major research university collected and compiled data on student characteristics such as class, number of sessions attended, grade point average, and…

Two procedures are presented for detecting violations of the unidimensionality assumption made by latent trait models without requiring factor analysis of inter-item correlation matrices. Both procedures require that departures from unidimensionality be hypothesized beforehand. This is usually possible in achievement tests where several content…

Data on all applicants to U.S. medical schools were analyzed to find how applicant characteristics affected the probability of admission, particularly the function of state of residence separately for majority and minority group applicants. Discriminant analysis and empirical Bayes methods were used, and the differences were discussed. (Author/CTM)

F. M. Lord's flexilevel, computerized adaptive testing (CAT) procedure was compared to an item-response theory-based CAT procedure that uses Bayesian ability estimation with various standard errors of estimates used for terminating the test. Ability estimates of flexilevel CATs were as accurate as were those of Bayesian CATs. (TJH)

Type I error rates of F. M. Lord's chi square test for differential item functioning were investigated using Monte Carlo simulations with marginal maximum likelihood estimation and marginal Bayesian estimation algorithms. Lord's chi square did not provide useful Type I error control for the three-parameter logistic model at these sample sizes.…

Estimating item parameters from a two-parameter normal ogive model is considered using Gibbs sampling to simulate draws from the joint posterior distribution of ability and item parameters. The method gives marginal posterior density estimates for any parameter of interest, as illustrated using data from a 33-item mathematics placement…

Analysis of a two-way sample of means is considered when corresponding population means are believed a priori to satisfy a partial order restriction. Simulation and the Gibbs sampler are used to summarize posterior distributions, and the posterior distribution is used to predict GPAs of first-year students at University of Iowa. (SLD)

Revealing or visualizing the thinking involved in making clinical decisions is a challenge. A case study is presented with a visual implement for sharing the diagnostic process. This technique adapts the Bayesian approach to the case presentation. Pretest probabilities and likelihood ratios are gathered to obtain post-test probabilities of every…

Based on the Dyches and Prater (2000) guidelines, characterizations and plots in 34 eligible children's books published during 1999-2003 were evaluated; 36 characterizations are discussed in detail in terms of each guideline. Results showed that, compared to a previous study (Dyches, Prater, & Cramer, 2001), characters with developmental…