Although Goodman-Kruskal gamma (G) is used relatively rarely it has promising potential as a coefficient of association in educational settings. Characteristics of G are studied in three sub-studies related to educational measurement settings. G appears to be unexpectedly appealing as an estimator of association between an item and a score because…

To address response style or bias in rating scales, forced-choice items are often used to request that respondents rank their attitudes or preferences among a limited set of options. The rating scales used by raters to render judgments on ratees' performance also contribute to rater bias or errors; consequently, forced-choice items have recently…

Several recent studies have employed item response theory (IRT) to rank incorrect responses to commonly used research-based multiple-choice assessments. These studies use Bock's nominal response model (NRM) for applying IRT to categorical (nondichotomous) data, but the response rankings only utilize half of the parameters estimated by the model.…

Recent context-control learning studies have shown that switch costs are reduced in a particular context predicting a high probability of switching as compared to another context predicting a low probability of switching. These context-specific switch probability effects suggest that control of task sets, through experience, can become associated…

Research on the graphical facilitation of probabilistic reasoning has been characterised by the effort expended to identify valid assessment tools. The authors developed an assessment instrument to compare reasoning performances when problems were presented in verbal-numerical and graphical-pictorial formats. A sample of undergraduate psychology…

Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers…

To rule out the need for a two-parameter item response theory (IRT) model during item analysis by Rasch models, it is important to check the Rasch model's assumption that all items have the same item discrimination. Biserial and polyserial correlation coefficients measuring the association between items and restscores are often used in an informal…

Examines the application of the Rasch simple logistic model to analogy test items. (RC)

Recent advances in item analysis have provided greater capabilities for the analysis of tests, but have also significantly increased the gap between the theory and practice of item analysis. This paper traces the lines of development in item analysis under latent trait theory. (MV)

The question of whether test factor structure is indicative of the test item hierarchy was examined. Data from 1,000 subjects on two sets of five bivalued Law School Admission Test items, which were analyzed with latent trait methods of Bock and Lieberman and of Christoffersson in Psychometrika, were analyzed with an ordering-theoretic method to…

The Rasch item analysis model is supposed to yield norm-free estimates of ability and easiness values, but there are several possible interpretations of the nature and extent of such norm-freeness. One such interpretation was that to involve the scores of one single experimental group of testees which were embedded in four differently skewed…

Selection of items for analogy tests according to the Rasch item probability of "goodness of fit" to the model is compared with three commonly used item selection criteria: item discrimination, item difficulty, and item-ability correlation. Word, picture, symbol and number analogies in multiple choice format were administered to several…