Evaluates a method for item selection in adaptive testing that is based on Kullback-Leibler information (KLI) (T. Cover and J. Thomas, 1991). Simulation study results show that testing algorithms using KLI-based item selection perform better than or as well as those using Fisher information item selection. (SLD)

Many exam programs have begun to include innovative item types in their operational assessments. While innovative item types appear to have great promise for expanding measurement, there can also be genuine challenges to their successful implementation. In this paper we present a set of four activities that can be beneficially incorporated into…

Commercial, nonthermal processing of food, such as high hydrostatic-pressure processing (HPP), has increased. The safety and quality of foods produced by HPP has not been well communicated to the public. An online, nationwide consumer survey was implemented to assess awareness of alternative food processing technologies, consumer food safety…

The IMS Question and Test Interoperability (QTI) standard identifies 16 different question types which may be used in online assessment. While some partial implementations exist, the R2Q2 project has developed a complete solution that renders and responds to all 16 question types as specified. In addition, care has been taken in the R2Q2 project…

Identifying dyslexia in adulthood presents particular challenges because of complicating factors such as acquisition of compensatory strategies, differing degrees of intervention and the problem of distinguishing dyslexic adults from those whose literacy difficulties have non-cognitive causes. One of the implications is that conventional literacy…

The CourseMarker system has been used to assess free-response computer based assessment (CBA) exercises since 1998. The aim of the studies reported here was to evaluate the feasibility and usefulness of developing and deploying diagram-based exercises using DATsys, an authoring environment for diagram-based CBA, together with CourseMarker.…

The influence of general and verbal ability on each of 72 verbal analogy test items were investigated with new factor analytical techniques. The analogy items together with the Computerized Swedish Enlistment Battery (CAT-SEB) were given randomly to two samples of 18-year-old male conscripts (n = 8566 and n = 5289). Thirty-two of the 72 items had…

Recognition memory for words was tested in same or different contexts using the remember/know response procedure. Context was manipulated by presenting words in different screen colors and locations and by presenting words against real-world photographs. Overall hit and false-alarm rates were higher for tests presented in an old context compared…

The main purpose of this study was to investigate the number sense performance of 3rd-graders in Taiwan, and to diagnose areas of weakness or deficiency in number sense development. A total of 808 3rd-graders participated in this study. The results indicated that these students did not perform well on each of the five number sense components…

Issues concerning the cost and feasibility of using Formulating Hypotheses (FH) test item types for the Graduate Record Examinations have slowed research into their use. This project focused on two major issues that need to be addressed in considering FH items for operational use: the costs of scoring and the assignment of scores along a range of…

This paper examines the history of approaches to diagnosis in education and in medicine--a profession with concentrated attention to the conceptual and mathematical underpinnings of diagnosis. Presented is a comprehensive model of diagnostic testing in education and a summary of the results of four studies, one from each of four separate…

This paper focuses on item design considerations faced by instructional designers and evaluators when using computer videodisc delivery systems as a means of assessing learner comprehension and competencies. Media characteristics of various interactive computer/videodisc training systems are briefly discussed as well as reasons for using such…

The requirements of the revised Elementary and Secondary School Act for annual assessment of student progress highlight problems in using tests in a stringent manner to assess students and teachers. Issues such as validity, reliability, and time spent on test preparation must be considered. Some tests are used for prediction of future performance,…

Computerized adaptive testing allows us to create a unique personalized test that matches the ability and knowledge of the test taker. (Author)

A group of covariance structure models was examined to ascertain the similarity between conventionally administered and computerized adaptive versions of the Differential Aptitude Test (DAT). Results for 332 students indicate that the computerized version of the DAT is an adequate representation of the conventional test battery. (TJH)