The use of new extension of standard Item Response Theory (IRT) modeling of dichotomous items to include external variables is proposed. External variables may appear both as categorical grouping variables and as continuous variables; this requires the formulation of a model for the relationships between the external variables and the response…

This paper reports the results of a behavioral anchoring analysis of the Iowa Tests of Basic Skills (Form G, Level 12) vocabulary (41 items) and reading comprehension (56 items) tests. Subjects were 82 sixth-grade students enrolled at the Carterville (Illinois) Grade School. More specifically, a curriculum-referenced interpretation of the ability…

Reasons for administering tests fall into two categories--decision-making and promoting learning. The two bases of tests are learning objectives and the level of learning at which training is developed. Test development involves a number of steps. The best way to tie objectives to test items is through the use of a table of specifications, which…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

An empirical item characteristic curve shows the probability of a correct response as a function of the student's total test score. These curves can be estimated from large-scale pretest data. They enable test developers to select items that discriminate well in the score region where decisions are made. A similar set of curves can be used to…

This initial study phase deals with the accuracy of the information provided by students on the newly revised Student Descriptive Questionnaire (SDQ). The SDQ, an optional part of the College Board's Admissions Testing Program, is intended to supplement the information base to improve the quality of decisions made by college admissions personnel,…

An item format incorporating pattern recognition was designed to assess medical students' abilities in the area of clinical diagnosis. A group of approximately 20 faculty members of five New England medical schools met in Worcester for half of a day to develop pattern recognition items. Teams of four to six physicians were assigned to work on…

This preliminary investigation explored a means of maximizing the use of standardized test results. In addition to the usual package of alpha and ranked norm-referenced test reports, a special series of reports by the California Test Bureau/McGraw-Hill was generated for remedial reading and mathematics teachers. These reports displayed primarily…

In order to evaluate our methods and approaches of estimating the operating characteristics of discrete item responses, it is necessary to try other comparable methods on similar sets of data. LOGIST 5 was taken up for this reason, and was tried upon the hypothetical test items, which follow the normal ogive model and were used frequently in…

The progress of modern mental test theory depends very much on the techniques of maximum likelihood estimation, and many popular applications make use of likelihoods induced by logistic item response models. While, in reality, item responses are nonreplicate within a single examinee and the logistic models are only ideal, practitioners make…

A detailed description of five latent structure models of achievement measurement is presented. The first project paper, by David L. McArthur, analyzes the history of mental testing to show how conventional item analysis procedures were developed, and how dissatisfaction with them has led to fragmentation. The range of distinct conceptual and…

On well-constructed multiple-choice tests, the most serious threat to measurement is not variation in item discrimination, but the guessing behavior that may be adopted by some students. Ways of ameliorating the effects of guessing are discussed, especially for problems in latent trait models. A new item response model, including an item parameter…

An empirical comparison of the validity of three Likert-type attitude scales measuring fourth to sixth grade students' attitudes toward school integration was conducted. The content-parallel forms differed only in terms of item phrasing and were composed of either all positive, all negative or a mix of items. Different factor solutions underlying…

Because item order and salience may affect the findings of social science research, a study was conducted to determine the effect of topic salience on subject response to different item orders. In the study, 10 high salience self-esteem items were presented with 10 low salience items concerning product labels in three versions. In the first…

This report describes the development and norming of parallel forms of the Air Force Reading Abilities Test (AFRAT) which have been designed for Air Force use as replacements for commercial reading tests. A previous study on service applicants found considerably divergent reading grade levels (RGL's) from different commercial tests for subjects of…