Item response curves for a set of binary responses are studied from a Bayesian viewpoint of estimating the item parameters. For the two-parameter logistic model with normally distributed ability, restricted bivariate beta priors are used to illustrate the computation of the posterior mode via the EM algorithm. The procedure is illustrated by data…

Instructors can use both "multiple-choice" (MC) and "constructed response" (CR) questions (such as short answer, essay, or problem-solving questions) to evaluate student understanding of course materials and principles. This article begins by discussing the advantages and concerns of using these alternate test formats and…

The factor-analytic history of the isolation and identification of the cognitive ability construct known as Number or Numerical Facility is described. Empirical documentation from the psychometric literature is discussed, and examples of items from a variety of tests which have defined and been associated with the Number factor are included to…

Some basic concepts of the one-parameter logistic latent-trait model, or the Rasch model, are presented. This model assumes that the probability of a correct answer to an item is a function of two parameters, one representing the difficulty of the item and one representing the ability of the subject. The purpose of this paper is to explain a…

The major emphasis of this paper is in the examination of test item response patterns. Tatsuoka and Tatsuoka (1980) have developed two indices of response consistency: the norm-conformity index (NCI) and the individual consistency index (ICI). The NCI provides a measure of the degree of consistency between the response pattern of an individual and…

This study discusses latent trait theory applications to test item bias methodology. A real data set is used in describing the rationale and application of the Rasch probabilistic model item calibrations across various ethnic group populations. A high school graduation proficiency test covering reading comprehension, writing mechanics, and…

The purpose of this paper is to examine the capabilities of various procedures for sorting dichotomously-scored items into unidimensional subjects. The procedures include: factor analysis, nonmetric multidimensional scaling, cluster analysis, and latent trait analysis. Both simulated and real data sets of known structure were used to evaluate the…

A method is described for choosing sample sizes when the domain to be sampled consists of a finite set of sentences and the purpose is to construct a test to assess the comprehension or the readability of written discourse. The testing method is that proposed in Bormuth's work on transformational analysis within a criterion-referenced measurement…

Specifying and writing appropriate items for student writing assessments is an exacting task. All too frequently, however, teachers approach this task by reading a skill statement and hurriedly writing a few items with correct answers combined with several distractors. This approach disregards the essentials of isolating a single skill for…

A procedural model is presented for the construction and validation of an attitude scale in vocational education; and the results of an instrumentation study using that model are discussed. The three-stage model is composed of: (1) stratification of the construct; (2) item construction and selection; and (3) item cluster analysis. In phase one,…

The problem of determining the significance level which should be used in statistical tests of item validity in order to minimize type I errors is discussed. (Author/JKS)

240 employed adults in 35 organizations completed a 70 item questionnaire based on current value/expectancy theories of motivation and the results of two prior factor analyses of motivation items. This yielded a hierarchical structure of motivation and eight reliable subscales. Results are discussed in terms of motivation theories, validities,…

Describes study which questioned theories of skill hierarchies in reading and states that it cannot be assumed either that the transfer of one skill in literacy is made to another skill or that a transfer is made to other "real life" reading situations. (JM)

Two approaches for determining the optimal number of choices for a test item, presently in the literature, are compared with two new approaches. (Author)

This study compared the item difficulty, item discrimination, and test reliability of three forms of multiple-choice items: (1) one correct answer; (2) "none of the above" as a foil; and (3) "none of the above" as the correct answer. Twelve items in the three formats were administered in a college statistics examination. (BS)