Most currently used measures of inter-rater agreement for the nominal case incorporate a correction for "chance agreement." The definition of chance agreement is not the same for all coefficients, however. Three chance-corrected coefficients are Cohen's Kappa; Scott's Pi; and the S index of Bennett, Goldstein, and Alpert, which has…

The Auto-Regressive Integrated Moving Average (ARIMA) Models, often referred to as Box-Jenkins models, are regression methods for analyzing sequential dependent observations with large amounts of data. The Box-Jenkins approach, a three-stage procedure consisting of identification, estimation and diagnosis, was used to select the most appropriate…

An alternative definition has been developed of the delta scale of item difficulty used at Educational Testing Service. The traditional delta scale uses an inverse normal transformation based on normal ogive models developed years ago. However, no use is made of this fact in typical uses of item deltas. It is simply one way to make the probability…

The models and procedures discussed in this paper are related to those presented in Bock and Aitkin (1981), where they considered the 2-parameter probit model and approximated a normally distributed prior distribution of abilities by a finite and discrete distribution. One purpose of this paper is to clarify the nature of the general EM (GEM)…

This monograph estimates both disequilibrium and equilibrium models of the U.S. labor market and compares the results and their implications for policy. Because a great deal of work in the U.S. labor market has followed the equilibrium paradigm, this essay devotes a disproportionate amount of time to discussing the problems that arise in…

A sample of 24 subjects was presented with 800 addition problems to test a general model of simple and complex addition. According to this model, an addition problem is encoded and verified by column, with specific addition strategies determined by the size of the problem. Two hundred problems each of the following four types were presented: (1)…

A probabilistic approach is introduced to classify and diagnose erroneous rules of operation resulting from a variety of misconceptions ("bugs") in a procedural domain of arithmetic. The model is contrasted with the deterministic approach which has commonly been used in the field of artificial intelligence, and the advantage of treating the…

The purpose of the present investigation is to examine the influence of sample size (N) and model complexity on a set of 23 goodness-of-fit (GOF) indices, including those typically used in confirmatory factor analysis. The focus was on two potential problems in assessing GOF: (1) some fit indices are substantially influenced by N so that tests of…

The construction of parallel tests from item response theory (IRT) based item banks is discussed. Tests are considered parallel whenever their information functions are identical. After the methods for constructing parallel tests are considered, the computational complexity of 0-1 linear programming and the heuristic procedure applied are…

Fisher's information measure for the item difficulty parameter in the Rasch model and its marginal and conditional formulations are investigated. It is shown that expected item information in the unconditional model equals information in the marginal model, provided the assumption of sampling examinees from an ability distribution is made. For the…

A procedure for the sequential optimization of the calibration of an item bank is given. The procedure is based on an empirical Bayes approach to a reformulation of the Rasch model as a model for paired comparisons between the difficulties of test items in which ties are allowed to occur. First, it is indicated how a paired-comparisons design…

Children learn arithmetic procedures by rote, rather than by constructing them with an understanding of numbers. Rote learning produces lack of flexibility, nonsensical errors, and other difficulties. Proposed is a theory of conceptual understanding and its role in learning and executing arithmetic procedures. The basic hypothesis is that…

As useful as LISREL may be in model estimation and testing, its most significant contribution to date is the encouragement and example it gives for right thinking about research and right planning of research. The encouragement to hypothesize the best possible model for the process that is the object of study, and to plan measurements that…

In an analysis of multitrait-multimethod matrices the criteria for discriminant validity are shown to include a "structure" criterion as an invariance of traits structure to methods. The criterion is meant to fit data to an additive model with traits and methods but not interaction terms. The importance of the structure criterion and the…

The Pearson and likelihood ratio statistics are frequently used for assessing the absolute fit of probability models. Researchers are often interested in comparing fits provided by different models which may have a subsuming or non-subsuming relation. A subsuming relation exists when the parameters of the reduced model form a subset of those…