Five-hundred dichotomously scored response patterns were generated with sequentially independent (SI) items and 500 with dependent (SD) items for each of thirty-six combinations of sampling parameters (i.e., three test lengths, three sample sizes, and four item difficulty distributions). KR-20, KR-21, and Split-Half (S-H) reliabilities were…

Item data from two scales of the Ohio Vocational Interest Survey were used to investigate the relationship between item-favorability and sex bias. Item-response data, item sex group interaction data, and item-total score correlational data were examined. It was found that item-favorability was not a suitable criterion for the identification of…

This research investigated the use of the Rasch simple logistic model in obtaining test-free ability estimates. Raw-score ability estimates were influenced by the difficulty of the items used in measurement but Rasch ability estimates were relatively independent of the item difficulty. (Author/CTM)

Test data from two diverse culture groups were analyzed to determine the agreement among four methods of detecting item bias (transformed difficulty, discrimination differences, chi-square, and item characteristic curve). The test battery contained 155 items from six subtests: vocabulary, reading comprehension, mathematics, letter groups,…

Advantages and disadvantages of a test item analysis method for producing item banks are discussed with respect to different teaching methods, curriculum, and the examination system. (MP)

Classical item analysis and Rasch latent trait analysis were applied to the responses of a sample of undergraduates to two measures concerning alcoholism. Little difference in terms of practical considerations was found between the methods. (JKS)

It is believed by some that most tests are multidimensional, meaning that they measure more than one underlying construct. The primary objective of this study is to illustrate how variations in the secondary ability distribution affect the statistical detection of dimensionality and to demonstrate the difference between substantive and statistical…

This paper reports the findings of an experiment that investigated the reactions of Saudi college students to collaborative learning techniques introduced in two modalities: face-to-face and web-based learning. Quantitative data were collected with a questionnaire that examined the changes of three constructs: attitudes toward collaboration,…

This paper explores alternative approaches for facilitating efficient, evidence-centered item development for a new type of verbal reasoning item developed for use on the GRE® General Test. Results obtained in two separate studies are reported. The first study documented the development and validation of a fully automated approach for locating the…

The effects of varying degrees of correlation between abilities and of various correlation configurations between item parameters on ability and item parameter estimation using the three parameter logistic model were examined. Ten two-trait configurations and one unidimensional test configuration for 30 item tests were simulated. Each…

To assess the effects of correlated abilities on test characteristics, and to explore the effects of correlated abilities on the use of a multidimensional item response theory model which does not explicitly account for such a correlation, two tests were constructed. One had two relatively unidimensional subsets of items, the other had all…

Five comparisons were made relative to the quality of estimates of ability parameters and item calibrations obtained from the one-parameter and three-parameter logistic models. The results indicate: (1) The three-parameter model fit the test data better in all cases than did the one-parameter model. For simulation data sets, multi-factor data were…

False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…

This study used a series of simulations to answer questions about the efficacy of adaptive testing raised by empirical studies. The first study showed that for reasonable high entry points, parameters estimated from paper-and-pencil test protocols cross-validated remarkably well to groups actually tested at a computer terminal. This suggested that…

When classes are the units of analyses, estimates of the reliability of class means are needed. Using classical test theory it is difficult to treat this problem adequately. Generalizability theory, however, provides a natural framework for dealing with the problem. Each of four possible formulas for the generalizability of class means is derived…