This study compared various equating models and procedures for a sample of data from the Medical College Admission Test(MCAT), considering how item response theory (IRT) equating results compare with classical equipercentile results and how the results based on use of various IRT models, observed score versus true score, direct versus linked…

As a continuing part of its validity studies, the Association of American Medical Colleges commissioned a study of the speediness of the Medical College Admission Test (MCAT). If speed is a hidden part of the test, it is a threat to its construct validity. As a general rule, the criterion used to indicate lack of speediness is that 80% of the…

This study explored the impact of various degrees of violations of the item response theory (IRT) local independence assumption on the Law School Admission Test (LSAT) calibration and score distribution estimates. Initially, results from the LSAT and two other tests were investigated to determine the approximate state of local item dependence…

The Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) was developed to measure personal preferences with regard to Jungian psychological types. Instruments in this area are among the most popular measures used in education and psychology; the measures are used in matching teaching and learning styles, in individual…

An item analysis study was conducted for two multiple-choice tests of introductory psychology created from a publisher's test bank. A 47-item multiple-choice test was administered to 247 students, and 433 students took a different 42-item multiple-choice test. Participants were from a large northeastern suburban community college. The difficulty…

This study examined the cross-lingual equating process adopted by a large scale testing system in which target language (TL) forms are equated to the source language (SL) forms using a set of translated items. The focus was on evaluating the degree of error inherent in the routine cross-lingual equating of the Verbal Reasoning subtest of the…

Three new computer-administered item types for the analytical scale of the Graduate Record Examination (GRE) General Test were developed and evaluated. One item type was a free-response version of the current analytical reasoning item type. The second item type was a somewhat constrained free-response version of the pattern identification (or…

In July of 1981, the Policy Council of the National Teacher Examinations (NTE), in conjunction with the Educational Testing Service in Princeton, New Jersey, completed a series of national surveys to review proposed changes in the NTE Commons Examinations. The survey was designed to tap varying perspectives on the proposed test content and its…

Undergraduate English faculty and faculty in six graduate fields were surveyed about students' academic listening needs. The objectives were (1) to obtain perceptions of the importance to academic success of various listening skills and activities, (2) to assess the degree to which both native and non-native speakers experience difficulties with…

This exploration of gender and test fairness first considers ways in which women and men sometimes differ in test performance, and then examines some of the aspects of why they differ, focusing on aspects that have implications for the design of fair tests. The first chapter introduces the context of the topic, the nature of test fairness, and the…

To discover factors which contribute to a high response rate for questionnaire surveys, the preferences of 150 college teachers and teaching assistants were studied. Four different questionnaire formats using 34 common items were sent to the subjects: open-ended; Likert-type (five points, from "strong influence to return," to…

The feasibility of pre-equating, or establishing conversions from raw to scaled scores through the use of pretest data before operationally administering a test, was investigated for the Scholastic Aptitude Test (SAT). Item-response theory based equating methods were used to estimate item parameters on SAT pretest data, instead of using final form…

The relationship of differential item functioning (DIF) to item difficulty on the Scholastic Aptitude Test (SAT) was examined, based on data from nine recent administrations of the test from June 1986 through December 1987. This pool of information includes item statistics on 765 verbal and 540 mathematical items computed for subgroups of White,…