During the past several decades, a new class of measurement theory, called latent trait (or item response) theory, has become popular. Supporters contend that results obtained through the use of this theory prove vastly superior to classical measurement statistics. This paper investigates the use of the Rasch model, one of the more popular latent…

The problem of obtaining designs that result in the most precise parameter estimates is encountered in at least two situations where item response theory (IRT) models are used. In so-called two-stage testing procedures, certain designs that match difficulty levels of the test items with the ability of the examinees may be located. Such designs…

An overview of the state of the art in psychological research is presented, with an emphasis on the attention given to effect sizes. The acceptance of small effect sizes for biomedical research is contrasted with the rejection of similar effect sizes for psychological research. The Binomial Effect Size Display is used to depict the practical…

This LISREL study examines the robustness of the maximum likelihood estimates under varying degrees of measurement model misspecification. A true model containing five latent variables (two endogenous and three exogenous) and two indicator variables per latent variable was used. Measurement model misspecification considered included errors of…

In the process of developing a conditionally-dependent item response theory (IRT) model, the problem arose of modeling an underlying multivariate normal (MVN) response process with general correlation among the items. Without the assumption of conditional independence, for which the underlying MVN cdf takes on comparatively simple forms and can be…

The purposes of the present investigation were to illustrate the applicability of categorization methodology for several empirical situations and to draw implications regarding the use of such methodology in examining categorical data. In using three tasks--two designed to measure cognitive dimensions (e.g., categorizing countries and categorizing…

Most currently used measures of inter-rater agreement for the nominal case incorporate a correction for "chance agreement." The definition of chance agreement is not the same for all coefficients, however. Three chance-corrected coefficients are Cohen's Kappa; Scott's Pi; and the S index of Bennett, Goldstein, and Alpert, which has…

The Auto-Regressive Integrated Moving Average (ARIMA) Models, often referred to as Box-Jenkins models, are regression methods for analyzing sequential dependent observations with large amounts of data. The Box-Jenkins approach, a three-stage procedure consisting of identification, estimation and diagnosis, was used to select the most appropriate…

An alternative definition has been developed of the delta scale of item difficulty used at Educational Testing Service. The traditional delta scale uses an inverse normal transformation based on normal ogive models developed years ago. However, no use is made of this fact in typical uses of item deltas. It is simply one way to make the probability…

The models and procedures discussed in this paper are related to those presented in Bock and Aitkin (1981), where they considered the 2-parameter probit model and approximated a normally distributed prior distribution of abilities by a finite and discrete distribution. One purpose of this paper is to clarify the nature of the general EM (GEM)…

This monograph estimates both disequilibrium and equilibrium models of the U.S. labor market and compares the results and their implications for policy. Because a great deal of work in the U.S. labor market has followed the equilibrium paradigm, this essay devotes a disproportionate amount of time to discussing the problems that arise in…

A sample of 24 subjects was presented with 800 addition problems to test a general model of simple and complex addition. According to this model, an addition problem is encoded and verified by column, with specific addition strategies determined by the size of the problem. Two hundred problems each of the following four types were presented: (1)…

A probabilistic approach is introduced to classify and diagnose erroneous rules of operation resulting from a variety of misconceptions ("bugs") in a procedural domain of arithmetic. The model is contrasted with the deterministic approach which has commonly been used in the field of artificial intelligence, and the advantage of treating the…

The purpose of the present investigation is to examine the influence of sample size (N) and model complexity on a set of 23 goodness-of-fit (GOF) indices, including those typically used in confirmatory factor analysis. The focus was on two potential problems in assessing GOF: (1) some fit indices are substantially influenced by N so that tests of…

The construction of parallel tests from item response theory (IRT) based item banks is discussed. Tests are considered parallel whenever their information functions are identical. After the methods for constructing parallel tests are considered, the computational complexity of 0-1 linear programming and the heuristic procedure applied are…