The Board of Registry (BOR) certifies medical technologists and other laboratory personnel. The BOR has studied adaptive testing for over 6 years and now administers all 17 BOR certification examinations using computerized adaptive testing (CAT). This paper presents an overview of the major research efforts from 1989 to the present related to test…

A series of computer simulations was run to measure the relationship between testlet validity and the factors of item pool size and testlet length for both adaptive and linearly constructed testlets. Results confirmed the generality of earlier empirical findings of H. Wainer and others (1991) that making a testlet adaptive yields only marginal…

The objective of this study was to determine the degree to which recommendations for passing scores, calculated on the basis of a traditional standard-setting methodology, might be affected by the mode (paper versus computer-screen prints) in which test items were presented to standard setting panelists. Results were based on the judgments of 31…

This paper focuses on item design considerations faced by instructional designers and evaluators when using computer videodisc delivery systems as a means of assessing learner comprehension and competencies. Media characteristics of various interactive computer/videodisc training systems are briefly discussed as well as reasons for using such…

Seventy-five subjects (Naval F-14 and E-2C crew members) were administered computer-based and paper-based tests of threat-parameter knowledge represented as a semantic network in order to determine the relative reliabilities and validities of these two assessment modes. Estimates of internal consistencies, equivalences, and discriminant validities…

This report presents factors to consider in the design of computer-based testing for all students, including students with disabilities and students with limited English proficiency. It also provides a process for the initial transformation of paper/pencil assessments to inclusive computer-based testing. Steps include: (1) assemble a group of…

Computerized adaptive testing allows us to create a unique personalized test that matches the ability and knowledge of the test taker. (Author)

Describes the modification of an already existing computer-assisted testing system at the University of Mississippi School of Health Related Professions to include test questions of the matching variety. (JJD)

The New Japanese version of the Minnesota Multiphasic Personality Inventory (MMPI) was administered twice to 200 Japanese female college students to verify the equivalence of the computer- and booklet-administered formats. For four scales, scores from the computer version were statistically significantly higher than those from the booklet…

Studied the cognitive equivalence of computerized and paper-and-pencil reading comprehension tests using verbal protocol analysis. Results for 48 college students indicate that the only significant difference between the computerized and paper-and-pencil tests was in the frequency of identifying important information in the passage. (SLD)

Part III of the National Board Examination--a certifying examination of medical knowledge and patient management abilities--was assessed using 1,866 first-year residents. This 15-year study comparing Part III results with those of Parts I and II and with superiors' ratings indicates Part III's validity and provides a model for future research.…

A group of covariance structure models was examined to ascertain the similarity between conventionally administered and computerized adaptive versions of the Differential Aptitude Test (DAT). Results for 332 students indicate that the computerized version of the DAT is an adequate representation of the conventional test battery. (TJH)

Reports on a study conducted to evaluate how individual differences in anxiety levels affect performance on computer versus paper-and-pencil forms of verbal sections of the Graduate Record Examination. Contrary to the research hypothesis, analysis of scores revealed that extroverted and less computer anxious subjects scored significantly lower on…

Describes how to construct questions to test all cognitive levels of learning for a course in introductory programming. The framework for learning is based on Bloom's taxonomy. Practical advice is given through examples and by describing a computer system to help deliver quizzes. Includes example questions. (Author/AEF)

In an engineering technology course at Coventry University (England), the utility of computer-assisted tests was compared with that of traditional paper-based tests. It was found that the computer-based technique was acceptable to students, produced valid results, and demonstrated potential for saving staff time. (Author/MSE)