A new approach to assessing unexpected differential item performance (item bias or item fairness) was developed and applied to the item responses of males and females to Scholastic Aptitude Test and Test of Standard Written English items administered operationally in December 1977. While the main body of the report describes the particulars of the…

Scales constructed under procedures and criteria outlined by the various traditional and latent trait methods were examined as to whether they varied in characteristics related to scale quality. Scales were constructed from a common pool of items analyzed in full form according to Likert and a one-parameter Rasch model for non-dichotomous data.…

In circumstances where judges are required to make ratings of performance, it is usually required to have two or more raters who are trained to agree on independent ratings of the same performance. It is suggested that such a requirement may produce the paradox of attenuation associated with item analysis, in which too high a correlation between…

A sample of slightly over 1,500 students from even-numbered grades in public schools of the U.S. Virgin Islands were given the 1973 edition of the Stanford Achievement Test (in grades 2, 4, 6, and 8) and the Test of Academic Skills (grades 10 and 12) in an attempt to assess student academic achievement in the basic skill areas of mathematics,…

The effects of item position on item statistics were studied in a large set of data from tests of word knowledge (WK) and arithmetic reasoning (AR). Position effects on item response theory (IRT) parameter estimates and classical item statistics were also investigated. Data were collected as part of a project to refine the Army's Computerized…

This study was designed to gather data on the meaning of imprecise terms from items written by physicians for their students and by test committees for national licensure and certification examinations. A total of 32 members of test committees who write examination items for various medical specialty examinations participated in the study. Each…

The three-parameter logistic model discussed was used by CTB/McGraw-Hill in the development of the Comprehensive Tests of Basic Skills, Form U (CTBS/U) and the Test of Cognitive Skills (TCS), published in the fall of 1981. The development, standardization, and scoring of the tests are described, particularly as these procedures were influenced by…

The specific performance characteristics of eight alternative cloze test formats were examined at the fourth and sixth grade levels. At each grade, 64 subjects were randomly assigned to one of four basic treatments (every-fifth/standard, every-fifth/cued, total random/standard, and total random/cued) and tested. Responses on each of the cloze…

The quality of mathematics multiple choice items and their susceptibility to test wiseness were examined. Test wiseness was defined as "a subject's capacity to utilize the characteristics and formats of the test and/or test taking situation to receive a high score." The study used results of the Graduate Record Examinations Aptitude Test (GRE) and…

The psychometric properties associated with the "specific objectivity" of the simple logistic model are acknowledged to be far superior to those of competing models. It is therefore the ideal model to be used for test development or for the analysis of any measuring instrument developed within a well-defined psychological construct. In…

Simple sum procedure of the conditional PDF approach (plausiblity of distractor function) combined with the normal approach method was applied for estimating the plausibility functions of the distractors of the Level II vocabulary subtest items of the Iowa Tests of Basic Skills. In so doing, the normal ogive model was adopted for the correct…

Recent developments in dichotomous factor analysis based on multidimensional item response models (Bock and Aitkin, 1981; Muthen, 1978) provide an effective method for exploring the dimensionality of questionnaire items. Implemented in the TESTFACT program, this "full information" item factor analysis accounts not only for the pairwise…

A set of procedures for validating the Army's Skill Qualification Tests (SQT) are described. Three phases are discussed: (1) the selection of tasks, (2) the selection of specific content for hands-on performance test items, and of written self-evaluation components, and (3) the establishment of content validity of the hands-on component. The task…

Cognitive style research is hindered by a variety of poorly described measures and style classifications and the use of small samples. This study described and compared three group measures of impulsivity/reflectivity, internal/external locus of control; and field dependence/independence to determine the distribution characteristics, psychometric…

Presented are results of a study attempting to design a reliable and valid instrument measuring the attitudes of teachers toward energy conservation. A 22-item scale is presented as a result of several administrations to preservice elementary teachers. Items were submitted to Likert Item Analysis and further validated by principle components…