Describes a three-phase process model for interface design, drawing on practices developed in the software industry and adapting them for computer-based languages tests. Describes good practice in initial design, emphasizes the importance of usability testing, and argues that only through following a principled approach to interface design can the…

An approach to scoring reading comprehension based on the concept of the testlet is described, using models developed for items in multiple categories. The model is illustrated using data from 3,866 examinees. Application of testlet scoring to multiple category models developed for individual items is discussed. (SLD)

Discussion of computer-assisted psychological evaluation focuses on its use as legal evidence. Topics discussed include legal criteria for expertise; clinical psychology and standards for expertise; factors relating to reliability and validity, including the proper use of data; computerized test administration; computer-based test interpretation;…

This book discusses adapting pencil-and-paper tests to computerized testing. Mention is made of models for graded responses to items and of possibilities beyond pencil-and-paper-tests, but the book is essentially about dichotomously scored test items. Contrasts between item response theory and classical test theory are described. (SLD)

Simulated data were used to investigate the impact of characteristics of threshold values (number, symmetry, and distance between adjacent threshold values) and delta values on the distribution of item information in the successive intervals Rasch model. Implications for computerized adaptive attitude measurement are discussed. (SLD)

An adaptive testing algorithm is presented based on an alternative modeling framework, and its effectiveness is investigated in a simulation based on real data. The algorithm uses a latent class modeling framework in which assessed latent attributes are assumed to be categorical variables. (SLD)

Presents two studies applying computerized adaptive testing (CAT) in schools. Compared paper-administered, computer-administered, and CAT modes for administering school achievement and assessment tests. Then compared computerized adaptive aptitude test results with individually administered Weschler Intelligence Scale for Children-Revised. Found…

A method of automatically selecting items for inclusion in a test with constraints on item content and statistical properties was applied to real data. Tests constructed manually from the same data and constraints were compared to tests constructed automatically. Results show areas in which automated assembly can improve test construction. (SLD)

Explains computerized adaptive testing (CAT) and its basis in item response theory. Describes a CAT program in pharmacology. (SK)

Provides information and strategies for helping language teachers know how to prepare students for the new computerized version of the Test of English as a Foreign Language. Information focuses on changes in scoring and test format. (Author/VWL)

Evaluated the effectiveness of vocabulary computerized adaptive tests (CATs) with restricted review in a live testing setting involving 242 college students in which special efforts were made to increase test efficiency and reduce the possibility of obtaining positively biased proficiency estimates. Results suggest the efficacy of allowing limited…

The hypothesis that previously found effects of self-adapted testing (SAT) are attributable to examinees' having an increased perception of control over a stressful testing situation was studied with 377 college students who took computerized adaptive tests or SAT. The strongest preference for SAT was seen in individuals with the highest…

Derives three reliability estimates for the Bayes modal estimate (BME) and the maximum-likelihood estimate (MLE) of theta in computerized adaptive tests (CATs). Computes the three reliability estimates and the true reliabilities of both BME and MLE for seven simulated CATs. Results show the true reliabilities for BME and MLE to be nearly identical…

Embarking on a high-stakes online testing program is a major enterprise that requires planning, teamwork, communication, flexibility and good problem-solving skills. It is important to be aware of the issues that one may confront and what hurdles might have to be overcome to be successful in the job. The Virginia Department of Education…

Most educators agree that the primary criterion of school success is the ongoing growth and achievement of every student even in the midst of constant debate about the state of the US education and conflicting opinions regarding the value of No Child Left Behind (NCLB). Standardized tests have their place, but computerized adaptive testing aimed…