The adequacy of several approaches to estimation of proficiency distributions for the Trial State Assessment (TSA) in eighth grade mathematics of the National Assessment of Educational Progress was examined. These approaches are more restrictive than the estimation procedures originally used, with the same kind of plausible-values approach that…

A powerful way of understanding something new is by analogy with something already known. An analogy is defined as a mapping from one structure, which is already known (the base or source), to another structure that is to be inferred or discovered (the target). The research community has given considerable attention to analogical reasoning in the…

Drawing on the authors' extensive experience at Stanford University as well as the work of others, this book offers the first systematic approach to fiscal and human resource planning at colleges and universities. It shows how decision models can and should become an integral part of the planning process. The uses and misuses of planning models in…

Methods for predicting specific college course grades, based on small numbers of observations, were investigated. These methods use collateral information across potentially diverse institutions to obtain refined within-group parameter estimates. One method, referred to as pooled least squares with adjusted intercepts, assumes that slopes and…

The shortcomings of the conventional way of using and interpreting multiple-choice tests are summarized. Some theories and methodologies that can be applied for better use multiple-choice test items are described. Empirical facts are introduced to support the theoretical observations. New strategies are proposed that will reduce "noise"…

This study was designed to obtain descriptive data on the classroom evaluation practices of secondary teachers in two different public school systems. A self-report survey instrument was employed to collect data from 217 teachers in York, England, and 217 teachers in Minnesota. Respondents were asked to indicate which specific techniques they…

When the three-parameter logistic model and item response theory are used to analyze Graduate Management Admission Test (GMAT) data, there are problems with the assumption of unidimensionality. Linear factor analytic models, exploratory factor analysis programs, and the comparison of item parameter estimates for heterogeneous and homogeneous…

This paper presents an introduction to the use of latent trait models for the estimation of domain scores. It was shown that these models provided an advantage over classical test theory and binomial error models in that unbiased estimates of true domain scores could be obtained even when items were not randomly selected from a universe of items.…

Multidimensional item difficulty (MID) is proposed as a means of describing test items which measure more than one ability. With mathematical story problems, for instance, both mathematical and verbal skills are required to obtain a correct answer. The proposed measure of MID is based upon three general assumptions: (1) the probability of…

This paper reports the results of a Monte Carlo investigation of Type I errors in the single group repeated measures design where multiple measures are collected from each observational unit at each measurement occasion. The Type I error of three multivariate tests were examined. These were the doubly multivariate F test, the multivariate mixed…

A Monte Carlo study of five indices of dimensionality of binary items used a computer model that allowed sampling of both items and people. Five parameters were systematically varied in a factorial design: (1) number of common factors from one to five; (2) number of items, including 20, 30, 40, and 60; (3) sample sizes of 125 and 500; (4) nearly…

The work presented in this paper defined conceptually the concepts of multidimensional discrimination and information, derived mathematical expressions for the concepts for a particular multidimensional item response theory (IRT) model, and applied the concepts to actual test data. Multidimensional discrimination was defined as a function of the…

Reading test data from the National Assessment of Educational Progress (NAEP) were scaled using the unidimensional item response theory model. Data were collected for students aged 9, 13, and 17. To determine whether the responses to the reading items were consistent with unidimensionality, four different methods were applied: (1) principal…

Approximately 1200 Danish school children aged 8, 11, and 14 participated in a questionnaire study under the caption, "Why I like to read." Data from Denmark formed part of an international study, in which 12 other countries used the same questionnaire to explore various functions of reading and to compare them over different countries.…

This investigation examined the influence of sample size on different goodness-of-fit indices used in confirmatory factor analysis (CFA). The first two data sets were derived from large normative samples of responses to a multidimensional self-concept instrument and to a multidimensional instrument used to assess students' evaluations of teaching…