The average Kullback-Keibler (K-L) information index (H. Chang and Z. Ying, in press) is a newly proposed statistic in Computerized Adaptive Testing (CAT) item selection based on the global information function. The objectives of this study were to improve understanding of the K-L index with various parameters and to compare the performance of the…

Computer-assisted and paper-and-pencil-administered formats for the Minnesota Multiphasic Personality Inventories were investigated. Subjects were 32 master's and doctoral-level counseling students. Findings indicated that the two formats were comparable and that students preferred the computer-assisted format. (AEF)

Presents two studies applying computerized adaptive testing (CAT) in schools. Compared paper-administered, computer-administered, and CAT modes for administering school achievement and assessment tests. Then compared computerized adaptive aptitude test results with individually administered Weschler Intelligence Scale for Children-Revised. Found…

A new computerized mastery test is described that builds on the Lewis and Sheehan procedure (sequential testlets) (1990), but uses fuzzy set decision theory to determine stopping rules and the Rasch model to calibrate items and estimate abilities. Differences between fuzzy set and Bayesian methods are illustrated through an example. (SLD)

Develops a conceptual framework that addresses score comparability for performance assessments, adaptive tests, paper-and-pencil tests, and alternate item pools for computerized tests. Outlines testing situation aspects that might threaten score comparability and describes procedures for evaluating the degree of score comparability. Suggests ways…

Powers, Burstein, Chodorow, Fowles, and Kukich (2002) suggested that automated essay scoring (AES) may benefit from the use of "general" scoring models designed to score essays irrespective of the prompt for which an essay was written. They reasoned that such models may enhance score credibility by signifying that an AES system measures the same…

Multidimensional adaptive testing (MAT) procedures are proposed for the measurement of several latent traits by a single examination. Bayesian latent trait estimation and adaptive item selection are derived. Simulations were conducted to compare the measurement efficiency of MAT with those of unidimensional adaptive testing and random…

This study examined the equivalency of computer and conventional versions of the Test of Workplace Essential Skills (TOWES), a test of adult literacy skills in Reading Text, Document Use and Numeracy. Seventy-three college students completed the computer version, and their scores were compared with those who had taken the test in the conventional…

The rapid growth of the Internet and intranets supports the infrastructure necessary for computer-based testing (CBT). The parallel growth of sophisticated computer programming and powerful computers offers new possibilities in testing, such as Computerized Adaptive Testing (CAT), where the responses of the subject dictate the nature of the test…

Traditionally, the fixed-length linear paper-and-pencil (P&P) mode of administration has been the standard method of test delivery. With the advancement of technology, however, the popularity of administering tests using adaptive methods like computerized adaptive testing (CAT) and multistage testing (MST) has grown in the field of measurement…

Abstract Research has demonstrated girls outperform boys on conventional literacy tests. The present studies concern gender differences on computerised educational tests. Seventy-one children were tested using LASS Secondary and a set of seven conventional measures. No significant gender differences were found on any of the LASS Secondary modules,…

Two procedures for classifying examinees into categories, one based on the sequential probability ratio test (SPRT) and the other on sequential Bayes methodology, were compared to determine which required fewer items for classification. Results showed that the SPRT procedure requires fewer items to achieve the same accuracy level. (SLD)

Discussion of computer-assisted testing focuses on a study of college students that investigated whether a computerized test which incorporated traditional test taking interfaces had any effect on students' performance, anxiety level, or attitudes toward the computer. Results indicate no difference in performance but a significant difference in…

Performed generalizability analyses of expert ratings and computer-produced scores for a computer-delivered performance assessment of physicians' patient management skills. The two automated scoring systems produced scores for the 200 medical students that were approximately as generalizable as those produced by the four expert raters. (SLD)

In the last few years, schools and universities have incorporated personal digital assistants (PDAs) into their teaching curricula in an attempt to enhance students' learning experience and reduce instructors' workload. One of the most common uses of PDAs in the classroom is as a test administrator. This study compared the usability effectiveness,…