When the three-parameter logistic model and item response theory are used to analyze Graduate Management Admission Test (GMAT) data, there are problems with the assumption of unidimensionality. Linear factor analytic models, exploratory factor analysis programs, and the comparison of item parameter estimates for heterogeneous and homogeneous…

This paper presents an introduction to the use of latent trait models for the estimation of domain scores. It was shown that these models provided an advantage over classical test theory and binomial error models in that unbiased estimates of true domain scores could be obtained even when items were not randomly selected from a universe of items.…

Multidimensional item difficulty (MID) is proposed as a means of describing test items which measure more than one ability. With mathematical story problems, for instance, both mathematical and verbal skills are required to obtain a correct answer. The proposed measure of MID is based upon three general assumptions: (1) the probability of…

A procedure which may be used to project the frequency distribution of one test onto that of another test is described and illustrated. The procedure is useful when a test developer wishes to construct an alternate form with preferred distributional characteristics. For example, the test developer may wish to construct a new test form with a…

The work presented in this paper defined conceptually the concepts of multidimensional discrimination and information, derived mathematical expressions for the concepts for a particular multidimensional item response theory (IRT) model, and applied the concepts to actual test data. Multidimensional discrimination was defined as a function of the…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

This handbook exists to assist the staff of a Springfield, Illinois school district in implementing the district assessment program and to assist other local school units in developing and assessing an implementation program. Chapter 1 presents information on the philosophical and pragmatic background of comprehensive assessment programs, with…

The standardization method of determining differential item functioning (DIF) is not acceptable for detecting biased items because of its methodological limitations. The main problems with the standardization index by N. J. Dorans and E. Kulick (1983) are: (1) it does not detect as DIF all items with large or aberrant group differences; (2) it…

Confirmatory factor analysis (LISREL VI) is the method best suited to the comparison of measurement models when those models are based on a priori assumptions. Traditionally, positive and negative item stems were mixed on affective scales to reduce response set bias since the item pairs were considered to be parallel. Recent studies indicate that…

A study investigated the effects of specific guidelines in the taking and rating of tests of summarizing ability. The subjects were 63 native-Hebrew-speaking students enrolled in English-as-a-Second-Language (ESL) courses at the Seminar Hakibbutzim Teacher Training College in Tel Aviv (Israel). The subjects were given two sets of instructions…

Issues in preparing a review form to detect item bias in tests are discussed and the first draft of an item bias review form is presented. While stereotyping is the consistent representation of a given group in a particular light, bias is the presence of some characteristic of an item that results in differential performance of two individuals of…

Reading test data from the National Assessment of Educational Progress (NAEP) were scaled using the unidimensional item response theory model. Data were collected for students aged 9, 13, and 17. To determine whether the responses to the reading items were consistent with unidimensionality, four different methods were applied: (1) principal…

Eighty Singapore teachers voluntarily participated in the evaluation of three new scales: (1) the Responsibility Scale, which measures the teacher's sense of responsibility, willingness to take on additional new duties, and perception of being assigned duties; (2) the Change Scale which measures the teacher's acceptance of changes in life as…

The cultural bias of the Adult Performance Level Assessment, Form AA-l (APLA) was examined. The potential influence of cultural differences on scores of a major ethnic group, Acadians or Cajuns, was investigated. Assessment items most prone to produce differences in scores were isolated and administered to selected groups. No significant…

This report contains accounts of studies, about scales to be used in the "A Study of Schooling" research project, undertaken to derive indices for constructs presumed to be measureable by composites of items. The report is introduced by a discussion on the rationale for selecting the research methodology used and an explanation of the…