It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

This paper presents a new hierarchical classes model, called Tucker2-HICLAS, for binary three-way three-mode data. As any three-way hierarchical classes model, the Tucker2-HICLAS model includes a representation of the association relation among the three modes and a hierarchical classification of the elements of each mode. A distinctive feature of…

This paper proposes a multidimensional generalization of Coombs' (1964) parallelogram model for "pick any/'n'" data, which result from each of a number of subjects having selected a number of objects (s)he likes most from a prespecified set of "n" objects. In the model, persons and objects are represented in a low dimensional space defined by a…

Proposes a mixture item response model for investigating individual differences in the selection of response categories in multiple choice items. A real data example illustrates how the model can be used to distinguish examinees disproportionately attracted to different types of distractors, and a simulation study evaluates item parameter recovery…

The effect of large, within-examinee item difficulty variability on estimates of the proportion of consistent classification of examinees into mastery categories was studied over 2 test administrations for 100 simulated examinees. The proportion of consistent classifications was adequately estimated using the technique proposed by M. Subkoviak…

This paper discusses the principles underlying discriminant analysis and constructs a simulated data set to illustrate its methods. Discriminant analysis is a multivariate technique for identifying the best combination of variables to maximally discriminate between groups. Discriminant functions are established on existing groups and used to…

This study compared the model of J. E. Grizzle, C. F. Starmer, and G. G. Koch (GSK, 1969) and log-linear model-based approaches for testing hypotheses in r x c contingency tables. Tables were simulated under various conditions of table, sample, row-effect size, and column-effect size. Test statistics for column (main) and interaction effects were…

The objectives of this research were to investigage (1) the feasibility of an index simulator, and (2) the use of a sequential analysis model for the automatic classification of documents. Index simulation was studied in general for various types of indexes, and in depth for the simulation of an inverted coordinate index to a document collection…

A computer simulation of Bayes' Theorem was conducted in order to determine the probability that an examinee was a master conditional upon his test score. The inputs were: number of mastery states assumed, test length, prior expectation of masters in the examinee population, and conditional probability of a master getting a randomly selected test…