Test-retest reliabilities and practice effect magnitudes were considered for nine computer-simulated tasks of everyday cognition and five traditional neuropsychological tests. The nine simulated everyday memory tests were from the Memory Assessment Clinic battery as follows: (1) simple reaction time while driving; (2) divided attention (driving…

An item-selection algorithm to neutralize the differential effects of time limits on scores on computerized adaptive tests is proposed. The method is based on a statistical model for the response-time distributions of the examinees on items in the pool that is updated each time a new item has been administered. Predictions from the model are used…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…

The goal of this project was to develop an inexpensive, self-contained system of hardware and software to support the development, administration, and evaluation of computerized adaptive tests. Toward that goal, commercial hardware was selected and a comprehensive software called the MicroCAT Testing System was developed. The MicroCAT system was…

This manual describes and explains the commands available in the ITEMBANK package (a comprehensive test item bank). True-false, multiple-choice, short-answer, and essay items, as well as the associated answers, can be accommodated. Content domains and behavior categories exist for item classification. Most menus have instant action. Items and…

The effects of presenting test items in random order or in a sequence parallel to the order of presentation were studied by testing 92 undergraduates in an introductory psychology course at Emporia State University (Kansas). Two test forms, sequential (S) and random (R), of multiple-choice questions were prepared for four 1-hour examinations…

In this report, selection theory is used as a theoretical framework from which mathematical algorithms for tailored testing are derived. The process of tailored, or adaptive, testing is presented as analogous to personnel selection and rejection on a series of continuous variables that are related to ability. Proceeding from a single common-factor…

This paper describes the implementation of a computer-based approach to scoring open-ended problem lists constructed to evaluate student and practitioner clinical judgment from real or simulated records. Based on 62 previously administered and scored problem lists, the program was written in BASIC for a Heathkit H11A computer (equivalent to DEC…

The overall purpose of this research was to compare a maximum likelihood based tailored testing procedure to a Bayesian tailored testing procedure. The results indicated that both tailored testing procedures produced equally reliable ability estimates. Also an analysis of test length indicated that reasonable ability estimates could be obtained…

Tailored testing increases the efficiency of tests by individually selecting for each person a set of items from an item pool so that the difficulty of the items selected will be such as to maximize the information provided by the score. The tailored testing procedure designed by Cliff orders persons and items on a common ordinal scale and…

The auditory receptive language skills of 40 learning disabled (LD) and 40 non-disabled boys (all 7 - 11 years old) were assessed via computerized versions of subtests of the Goldman-Fristoe-Woodcock Auditory Skills Test Battery. The computerized assessment correctly identified 92.5% of the LD group and 65% of the normal control children. (DB)

This study investigated the effects of past computer experience on the computerized aptitude test performance of college students. Subjects were 92 undergraduates who completed an arithmetic reasoning test by computer and a Computer Experience Questionnaire. Past computer experience did account for a significant amount of variance on the…

School psychologists and education students and faculty were asked to distinguish between computer-generated and individually written psychological test comments and indicate cues used in making identifications. Even though results indicate correct identification did not differ significantly from chance, school assessment reports must provide more…

To reduce the cost of item writing and to enhance the flexibility of item presentation, items can be generated by item-cloning techniques. An important consequence of cloning is that it may cause variability on the item parameters. Therefore, a multilevel item response model is presented in which it is assumed that the item parameters of a…