Describes the many causes of pressure to change large-scale assessment in the United States and suggests that the largest factor facilitating change will be technological, especially the use of the Internet. The Internet will help revolutionize the business and substance of large-scale assessment. (SLD)

Reviews the advantages and disadvantages of computer-based language tests, explores in detail developments in Internet-based testing using the examples of the Test of English as a Foreign Language and DIALANG--an innovative on-line suite of diagnostic tests and self-assessment procedures in 14 European languages--and outlines a research agenda for…

Evaluated the relative accuracy of the weighted likelihood estimate (WLE) of T. Warm (1989) compared to the maximum likelihood estimate (MLE), expected a posteriori estimate, and maximum a posteriori estimate. Results of the Monte Carlo study, which show the relative advantages of each approach, suggest that the test termination rule has more…

This book contains a series of research articles about computerized adaptive testing (CAT) written for advanced psychometricians. The book is divided into sections on: (1) item selection and examinee scoring in CAT; (2) examples of CAT applications; (3) item banks; (4) determining model fit; and (5) using testlets in CAT. (SLD)

Extended the use of a beta prior in trait estimation to the maximum expected a posteriori (MAP) method of Bayesian estimation. This new method, essentially unbiased MAP, was compared with MAP, essentially unbiased expected a posteriori, weighted likelihood, and maximum-likelihood estimation methods. The new method significantly reduced bias in…

Proposes a procedure for empirical initialization of the trait (theta) estimator in adaptive testing that is based on the statistical relation between theta and background variables known prior to test administration. Illustrates the procedure for an adaptive version of a test from the Dutch General Aptitude Battery. (SLD)

The Internet has significantly changed the way people conduct business, communicate, and live. In this article, the authors' focus is on how the Internet influences the practice of psychology as it relates to testing and assessment. The report includes 5 broad sections: background and context, new problems yet old issues, issues for special…

Recent studies have shown that restricting review and answer change opportunities on computerized adaptive tests (CATs) to items within successive blocks reduces time spent in review, satisfies most examinees' desires for review, and controls against distortion in proficiency estimates resulting from intentional incorrect answering of items prior…

In the last few years, schools and universities have incorporated personal digital assistants (PDAs) into their teaching curricula in an attempt to enhance students' learning experience and reduce instructors' workload. One of the most common uses of PDAs in the classroom is as a test administrator. This study compared the usability effectiveness,…

Nonparametric item response models have been developed as alternatives to the relatively inflexible parametric item response models. An open question is whether it is possible and practical to administer computerized adaptive testing with nonparametric models. This paper explores the possibility of computerized adaptive testing when using…

The present studies were undertaken to examine the effects of manipulating delay-interval task (Study 1) and timing of feedback (Study 2) on acquisition and retention. Participants completed a 100-item cumulative final examination, which included 50 items from each laboratory examination, plus 50 entirely new items. Acquisition and retention were…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

In recent years, a controversy has arisen about the advisability of allowing examinees to review their test items and possibly change answers. Arguments for and against allowing item review are discussed, and issues that a test designer should consider when designing a Computerized Adaptive Test (CAT) are identified. Most CATs do not allow…

This study examined computerized adaptive testing and cognitive ability testing of adults with cognitive disabilities. Adult subjects (N=250) were given computerized tests on language usage and space relations in one of three administration conditions: paper and pencil, fixed length computer adaptive, and variable length computer adaptive.…

This paper discusses equity issues that may arise from the widespread use of high stakes computerized testing. The literature relevant to computerized testing is examined from the perspective of equity concerns from within the framework of research and from the perspective of possible uses of computerized testing if equity issues are considered…