A simulation study to determine appropriate linking methods for adaptive testing items was designed. Three basic data sets for responses were created. These were randomly sampled, systematically sampled, and selected data sets. The evaluative criteria used were fidelity of parameter estimation, asymptotic ability estimates, root-mean-square error…

A study was commissioned to develop and validate a test to assess the attitudes of Alberta (Canada) students toward the world of work. An instrument was needed to examine the following five areas of concern: (1) attitudes toward earning a living; (2) perceptions about employer expectations; (3) perceptions about available opportunities; (4)…

The purpose of the present research was to study, systematically, the "goodness-of-fit" of the one-, two-, and three-parameter logistic models. We studied, using computer-simulated test data, the effects of four variables: variation in item discrimination parameters, the average value of the pseudo-chance level parameters, test length,…

Part One of this guide explores issues in English proficiency testing. Tests are discussed in terms of the aspect of language tested, and of different kinds of test tasks. The following kinds of test task defects are treated: (1) tests that required literacy skills, (2) tasks that reduce to a vocabulary test, and (3) errant notions of linguistic…

Criticisms of norm referenced standardized tests are contrasted with the assumption and claims of proponents of Rasch model testing and item banking. The Rasch test theory model is based on the assumption of equal interval curriculum referenced scales for both students' abilities and test item difficulties. The Portland school district has…

In computer assisted test construction (CATC) systems, the computer is used to perform the mechanical aspects of testing while the teacher retains control over question content. Advantages of CATC systems include question banks, decreased importance of test item security, computer analysis and response to student test answers, item analysis…

A specially designed answer format was used for three tests in a college level agriculture class of 19 students to record responses to three things about each item: (1) the student's choice of the best answer; (2) the degree of certainty with which the answer was chosen; and (3) all the answer choices which the student was certain were incorrect.…

An explanation is given of what is meant by "sample-free" item calibration and by "item-free" person measurement as these terms are applied to the one-parameter logistic test theory model of Georg Rasch. When the difficulty of an item is calibrated separately for two different samples the results may differ; but, according the…

COOPERATIVE EXTENSION SERVICE APPLICATION BLANKS WERE EVALUATED WITH SPECIAL ATTENTION TO THEIR VALUE IN PERSONNEL SELECTION. EXTENSION AGENT APPLICATION BLANKS FROM THE 50 STATE EXTENSION SERVICES WERE ANALYZED TO DETERMINE COMMON AND UNUSUAL ITEMS. RESPONSES SUBMITTED BY 194 APPLICANTS TO THE MINNESOTA COOPERATIVE EXTENSION SERVICE WERE ALSO…

The complexity of defining accurate passing scores with a minimum classification error when evaluating criterion-referenced, multiple-choice tests has been a major problem for classroom teachers. Therefore, a practical procedure in which the instructor determines the plausibility of each item option for the minimally acceptable examinee is…

Multiple-choice items were used to measure knowledge of drug abuse among four distinct groups of college students in the Los Angeles area. No difference in knowledge was found about five aspects of drug abuse measured by subscales of the instrument. These findings suggest that knowledge about drugs is remarkably uniform, although the students…

The question of whether test factor structure is indicative of the test item hierarchy was examined. Data from 1,000 subjects on two sets of five bivalued Law School Admission Test items, which were analyzed with latent trait methods of Bock and Lieberman and of Christoffersson in Psychometrika, were analyzed with an ordering-theoretic method to…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

In order to screen out items which may be biased against some ethnic group prior to the final selection of items in test construction, a statistical technique for assessing item bias was developed. Based on a theoretical formulation of R. B. Darlington, the method compares the performance of individuals who belong to different ethnic groups, but…

In latent trait models the standard procedure for handling the problem caused by guessing on multiple choice tests is to estimate a parameter which is intended to measure the "guessingness" inherent in an item. Birnbaum's three parameter model, which handles guessing in this manner, ignores individual differences in guessing tendency. This paper…