Item response theory (IRT) refers to a family of mathematical models which describe the relationship between latent continuous variables (attributes or characteristics) and their manifestations (dichotomous/polytomous observed outcomes or responses) with regard to a set of item characteristics. Researchers typically use parametric IRT (PIRT)…

Many organizations utilize some form of automation in the test assembly process; either fully algorithmic or heuristically constructed. However, one issue with heuristic models is that when the test assembly problem changes the entire model may need to be re-conceptualized and recoded. In contrast, mixed-integer programming (MIP) is a mathematical…

Computerized adaptive testing is subject to security problems, as the item bank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose a…

Refined item digraph analysis (RIDA) is a way of studying diagnostic and prescriptive testing. It permits assessment of a test item's diagnostic value by examining the extent to which the item has properties of ideal items. RIDA is illustrated with the Orange Juice Test, which assesses the proportionality concept. (TJH)

Deciding whether sets of test data are consistent with any of a large class of item response models is considered. The assumption of local independence is weakened to a new condition, local nonnegative dependence (LND). Necessary and sufficient conditions are derived for a LND item response model. (Author/JKS)

The equivalence between non-parametric marginal logistic models (NMLMs) and a class of discrete marginal logistic models is examined. Parametric models offer some of the advantages of the NMLMs approach, but there are more restrictions on the manifest probabilities. (SLD)

Formulas for computing the exact signed and unsigned areas between two item characteristic curves (ICCs) are presented. It is further shown that when the "c" parameters are unequal, the area between two ICCs is infinite. The significance of the exact area measures for item bias research is discussed. (Author)

A method for detecting and interpreting disturbances of the local-independence assumption among items that share common stimulus material or other features is presented. Dichotomous and polytomous Rasch models are used to analyze structure of the learning outcome superitems. (SLD)

Two discrimination coefficients, known as "disco" and "odisco," are proposed for measuring the extent of overlap in distributions as a direct function of the variance between the arithmetic means. These coefficients are related to K. Pearson's "eta" (1905) and R. A. Fisher's "F" (1950). (SLD)

It is demonstrated, theoretically and empirically, that item sets can be selected that meet the unidimensionality assumption of most item response theory models, even though they require more than one ability for a correct response. A method for identifying such item sets for test development purposes is presented. (SLD)

Contingency analyses have been employed to assess the degree to which outcomes of successive tests of corresponding items deviate from stochastic independence. A method of adjusting contingency tables to remove the effects of subject and item inhomogeneities, is presented. The method represents a partial solution to the "Simpson's…

The applicability of a new multiple-group factor analysis of dichotomous variables is shown and contrasted with the item response theory approach to item bias analysis. Situations are considered where the same set of test items has been administered to more than one group of examinees. (Author/BS).

Drawing on recently developed methodology for structural equation modeling with categorical data, this article proposes a new approach for investigating the behavior of dichotomously scored test items in relation to other relevant (observed) variables. A linear structural model relates the latent ability variable to a set of observed scores.…

A method is proposed for equating different sets of items administered to different groups using the Rasch model. The Rasch equating model formulated describes one common Rasch scale in different groups with different but overlapping item sets. The model, based on the quasi-loglinear Rasch model, can be tested globally. (SLD)

Three item selection methods for criterion-referenced tests are examined: the classical theory of item difficulty and item-test correlation; the latent trait theory of item characteristic curves; and a decision-theoretic approach for optimal item selection. Item contribution to the standardized expected utility of mastery testing is discussed. (CM)