Selection of items for analogy tests according to the Rasch item probability of "goodness of fit" to the model is compared with three commonly used item selection criteria: item discrimination, item difficulty, and item-ability correlation. Word, picture, symbol and number analogies in multiple choice format were administered to several hundred college students. Analysis showed that Rasch item probabilities of .05 and .01 are more lenient (in terms of proportion of items rejected) criteria than commonly used criteria (item difficulty of between .10 and .80, item discrimination of .20, item-ability correlation of .20). Results also showed only a moderate amount of overlap among the four criteria, with the Rasch item probability and item discrimination being the most similar, and item difficulty and item-ability correlates being the most dissimilar. (Author)