The purpose of this study was to evaluate the use of log-linear models in detecting test item bias. The evaluation of the log-linear approach in this regard will focussed on the following: (1) the stability of the procedure across replications--the effect of sampling error across random samples of ethnic groups; (2) the amount of artifactual…

Diagnostic testing confronts several challenges at once, among which are issues of test interpretation and immediate modification of the test itself in response to the interpretation. Several methods are available for administering and evaluating a test in real-time, towards optimizing the examiner's chances of isolating a persistent pattern of…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

The use of three remedies for errors in the measurement of ability that arise from differences in rater stringency is discussed. Models contrasted are: (1) Conventional; (2) Handicap; and (3) deterministic Rater Response Theory (RRT). General model requirements, power, bias of measures, computing cost, and complexity are contrasted. Contrasts are…

Statistical models for school effectiveness rankings are assessed. An analysis of linear models with fixed regression parameters and models with separate regression parameters for each school is presented. In the first case, the regression lines are parallel and the ranking of the schools is the same for all student backgrounds. In the second…

A method for estimating the parameters of the Rasch model is examined. The unknown quantities in this method are the item parameters and the distribution function of the latent trait over the population. In this sense, the method is equivalent to marginal maximum likelihood estimation. The new procedure is based on a method suggested by J. Kiefer…

In order to evaluate our methods and approaches of estimating the operating characteristics of discrete item responses, it is necessary to try other comparable methods on similar sets of data. LOGIST 5 was taken up for this reason, and was tried upon the hypothetical test items, which follow the normal ogive model and were used frequently in…

Optimal appropriateness indices, recently introduced by Levine and Drasgow (1984), provide the highest rates of detection of aberrant response patterns that can be obtained from item responses. These optimal appropriateness indices are used to study three important problems in appropriateness measurement. First, the maximum detection rates of two…

Based on the game "Prisoners' Dilemma," a game-theoretical model of the arms race suitable for postsecondary level mathematics and/or political science students is developed in which two players can initially choose any level of arms development. The purpose of the game is to show under what conditions deescalation rather than escalation…

The progress of modern mental test theory depends very much on the techniques of maximum likelihood estimation, and many popular applications make use of likelihoods induced by logistic item response models. While, in reality, item responses are nonreplicate within a single examinee and the logistic models are only ideal, practitioners make…

A detailed description of five latent structure models of achievement measurement is presented. The first project paper, by David L. McArthur, analyzes the history of mental testing to show how conventional item analysis procedures were developed, and how dissatisfaction with them has led to fragmentation. The range of distinct conceptual and…

On well-constructed multiple-choice tests, the most serious threat to measurement is not variation in item discrimination, but the guessing behavior that may be adopted by some students. Ways of ameliorating the effects of guessing are discussed, especially for problems in latent trait models. A new item response model, including an item parameter…

In order to determine the economic impact of a college on its local community, the short-term cash-flow relationships are translated into models representing the economic components and the transactions that typically occur. A series of models derived from an American Council on Education publication are presented for the use of higher education…

The Preliminary Scholastic Aptitude Test/National Merit Scholarship Qualifying Test (PSAT/NMSQT) was equated to the Scholastic Aptitude Test (SAT) using item response theory (IRT) in a three-parameter logistic model. Estimated true formula score equating was used. Only the mathematical sections of the PSAT/NMSQT and SAT were used because the…

The effects of varying degrees of correlation between abilities and of various correlation configurations between item parameters on ability and item parameter estimation using the three parameter logistic model were examined. Ten two-trait configurations and one unidimensional test configuration for 30 item tests were simulated. Each…