A few multi-dimensional items were found to be more efficient than a larger number of uni-dimensional items in tests for participant selection and evaluation of such compensatory educational programs as Title I. A multi-dimensional scaling technique is described which derives scores for each item on three dimensions, and allows multiple scores to…

The Preliminary Scholastic Aptitude Test/National Merit Scholarship Qualifying Test (PSAT/NMSQT) was equated to the Scholastic Aptitude Test (SAT) using item response theory (IRT) in a three-parameter logistic model. Estimated true formula score equating was used. Only the mathematical sections of the PSAT/NMSQT and SAT were used because the…

The effects of varying degrees of correlation between abilities and of various correlation configurations between item parameters on ability and item parameter estimation using the three parameter logistic model were examined. Ten two-trait configurations and one unidimensional test configuration for 30 item tests were simulated. Each…

To assess the effects of correlated abilities on test characteristics, and to explore the effects of correlated abilities on the use of a multidimensional item response theory model which does not explicitly account for such a correlation, two tests were constructed. One had two relatively unidimensional subsets of items, the other had all…

Argues that there is room for both those tests that focus on stable between-individual gains, and discusses how to evaluate a test along both the psychometric and edumetric dimensions. (Author/JM)

A method of estimating the operating characteristics of a new test item added to an established test without assuming a prior model has been proposed by the author. In this paper, the author extends this logic by proposing a different hypothesized distribution of the resulting estimate. The former method used a normal approximation; the present…

Five comparisons were made relative to the quality of estimates of ability parameters and item calibrations obtained from the one-parameter and three-parameter logistic models. The results indicate: (1) The three-parameter model fit the test data better in all cases than did the one-parameter model. For simulation data sets, multi-factor data were…

False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…

Responding to publicity about declining computation scores on standardized tests, the author conducted a study comparing October with May testing and timed with untimed tests. He concluded that students today are able to compute but do so more slowly than earlier students and earn higher scores on applications and concepts. (SD)

This book is intended for teachers of second and foreign languages who use and construct tests while they teach. The emphasis is on the process of testing, as well as the process involved in taking a test. The five chapters treat the following points: (1) an overview of classroom testing, its nature, process, and value; (2) a theoretical framework…

Research on the Rasch model of test and item analysis was applied to tests constructed from item banks for reading and mathematics with respect to five practical problems for scaling items and equating test forms. The questions were: (1) Does the Rasch model yield the same scale value regardless of the student sample? (2) How many students are…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

Item characteristic curve (ICC) theory describes the relationship between the ability of individuals and the probability of their answering a test question correctly; it is useful in estimating test scores, equating the scores of various tests, and scoring responses during adaptive testing. A simulation study of the effectiveness of the following…

A new approach to item analysis, concerned not only with differences among individuals, but also differences among the groups in which the individuals may have membership, is described. This multi-level aspect may be applied to studies of differences among individuals, classes, and schools, depending upon the kind of problem being studied and the…

The viewpoint is expressed that adding to test reliability by either selecting a more homogeneous set of items, restricting the range of item difficulty as closely as possible to the most efficient level, or increasing the number of items will not add to test validity and that there is considerable danger that efforts to increase reliability may…