When norming tests, it may be preferable to use the matrix sampling technique. The results from the samples may be used to estimate what the distribution of scores would have been if each subject had taken all the items. This paper compares four methods for making these estimates. The sample size made it possible to compare the techniques in a…

This study applied the maximum expected information (MEI) and the maximum posterior-weighted information (MPI) approaches of computer adaptive testing item selection to the case of a test using polytomous items following the partial credit model. The MEI and MPI approaches are described. A simulation study compared the efficiency of ability…

In November of 2007, Alberta Advanced Education and Technology contracted Insightrix Research, Inc. to conduct a survey of individuals who graduated from post-secondary institutions in Alberta in the fall of 2005 or the spring of 2006 (excluding apprenticeship graduates, who are surveyed through a separate initiative). The purpose of the survey is…

The predictive analysis approach to adaptive testing originated in the idea of statistical predictive analysis suggested by J. Aitchison and I.R. Dunsmore (1975). The adaptive testing model proposed is based on parameter-free predictive distribution. Aitchison and Dunsmore define statistical prediction analysis as the use of data obtained from an…

In a situation where the population distribution of latent trait scores can be estimated, the ordinary maximum likelihood estimator of latent trait scores may be improved upon by taking the estimated population distribution into account. In this paper empirical Bayes estimators are compared with the liklihood estimator for three samples of 300…

A linear classification rule (used with equal covariance matrices) was contrasted with a quadratic rule (used with unequal covariance matrices) for accuracy of internal and external classification. The comparisons were made for seven situations which resulted from combining three data conditions (equal and unequal covariance matrices, minimal and…

Bayes Theorem leads to three indexes of item effectiveness: 1) probability that an examinee knows the content given that the correct response was selected; 2) probability that an examinee does not know that content given that an incorrect response was selected; and 3) probability of making a correct decision about the examinee's knowledge given…

An alternative to the Rasch model is introduced. It characterizes strength of response according to the ratio of ability and difficulty parameters rather than their difference. Joint estimation and marginal estimation models are applied to two test data sets. (SLD)

Through Monte Carlo simulation, respective normative and intuitive strategies for covariation assessment and Bayesian inference are compared. Results indicate that better performance in both tasks results from considering alternative hypotheses, although not necessarily using a normative strategy. Conditions under which intuitive strategies may be…

The effects of a fixed and variable entry procedure on bias and information of a Bayesian adaptive test were compared. Neither procedure produced biased ability estimates on the average. Bias at the distribution extremes, efficiency curves, item subsets generated for administration, and items required to reach termination are discussed. (TJH)

Previous studies have suggested that nonnative (L2) linguistic sounds are accommodated to native language (L1) phonemic categories. However, this conclusion may be compromised by the use of explicit discrimination tests. The present study provides an implicit measure of L2 phoneme discrimination in early bilinguals (Catalan and Spanish).…

The purpose of this study was to explore the place of friendship in mentoring relationships among two female literacy education professors and three female doctoral students enrolled at neighboring universities. The authors used West and Oldfather's (1995) pooled case comparison approach to analyze the data from two separate studies: one that was…

During the 2009-2010 school year, Marzano Research Laboratory (MRL) was commissioned by Promethean Ltd. to conduct a second year evaluation study of the effects of Promethean ActivClassroom on student academic achievement. This report describes the findings from the second year study along with aggregate findings from the first and second year…

F. M. Lord's flexilevel, computerized adaptive testing (CAT) procedure was compared to an item-response theory-based CAT procedure that uses Bayesian ability estimation with various standard errors of estimates used for terminating the test. Ability estimates of flexilevel CATs were as accurate as were those of Bayesian CATs. (TJH)

The purpose of this paper is to link empirical Bayes methods with two specific topics in item response theory--item/subtest regression, and testing the goodness of fit of the Rasch model--under the assumptions of local independence and sufficiency. It is shown that item/subtest regression results in empirical Bayes estimates only if the Rasch…