This paper argues that no single measurement strategy serves all purposes and that applying methods and techniques which allow a variety of data elements to be retrieved and juxtaposed may be an investment in the future. Item response theory, Rasch model, and latent trait theory are all approaches to a single conceptual topic. An abbreviated look…

Mastery tests are analyzed in terms of the number of skills to be mastered and the number of items per skill, in order that correct decisions of mastery or nonmastery will be made to a desired degree of probability. It is assumed that a random sample of skills will be selected for measurement, that each skill will be measured by the same number of…

Discusses some of the aspects of problem solving that teachers can observe for assessment purposes in a student's practical and written work. Suggests that these observations can be incorporated into a student's assessment traditionally or using alternative assessment devices. (PK)

The validity of the assumptions under which the ordinal true score test theory was derived was examined using (1) simulation based on classical test theory; (2) a long empirical test with data from 321 sixth graders; and (3) an extensive simulation with 480 datasets based on the 3-parameter model. (SLD)

The difference between item bias and item impact and the way they relate to item validity are discussed from a multidimensional item response theory perspective. The Mantel-Haenszel procedure and the Simultaneous Item Bias strategy are used in a Monte Carlo study to illustrate detection of item bias. (SLD)

A procedure is presented for examining the influence of instruction on responses to test items by extending item response theory to incorporate variables illustrating different amounts of opportunity to learn. Data from the Second International Mathematics Study (grade 8 scores for about 7,000 students) illustrate the discussion. (SLD)

The use of restricted item response models to test hypotheses regarding item difficulty ordering and slope uniformity was demonstrated in a study in which 597 algebra students were asked to solve word problems reflecting various types of cognitive processing. Benefits and limitations of the procedures are discussed. (SLD)

The usefulness of latent class modeling in addressing several measurement issues is demonstrated via a study of 74 good and 74 poor readers in grades 5 and 6. Procedures were particularly useful for assessing the hierarchical relation among skills and for exploring issues related to item domains. (SLD)

A Monte Carlo study was conducted to compare the performance of three statistical indices of test item bias in small samples of examinees. The statistical indices compared were the Delta method, the Mantel-Haenszel (MH) method, and the Standardization method. Sample sizes of 50, 100, and 200 were examined. One thousand samples of each size were…

A predictive adaptive testing (PAT) strategy was developed based on statistical predictive analysis, and its feasibility was studied by comparing PAT performance to those of the Flexilevel, Bayesian modal, and expected a posteriori (EAP) strategies in a simulated environment. The proposed adaptive test is based on the idea of using item difficulty…

This study investigates two fixed parameter models for calibrating test items for an item bank under local school district control. Mathematics, reading, and language tests administered to students (Grades 7-9) provided the criterion information. Model I used calibrations from the Northwest Evaluation Association Item Bank to calibrate new items…

Dichotomous search strategies (DSSs) for computerized adaptive testing are similar to golden section search strategies (GSSSs). Each middle point of successive search regions is a testing point. After each item is administered, the subject's obtained score is compared with the expected score at successive testing points. If the subject's obtained…

Test item selection techniques based on traditional item analysis methods were compared to techniques based on item response theory. The consistency of mastery classifications in criterion referenced reading tests was examined. Pretest and posttest data were available for 945 first and second grade students and for 1796 fourth to sixth grade…

The Rasch model for test analysis is described and compared with two-parameter and three-parameter latent-trait models. Conditional maximum likelihood equations for estimating item parameters are derived, and estimates of person parameters are described together with their confidence intervals. Goodness of fit tests are discussed, including a…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…