Research on psychometric methods is heavily dependent on software. The quality, availability, and documentation of such software are critical to the advancement of the field. In 2000, an ad hoc committee of NCME recommended that NCME adopt policies that promote greater availability and better documentation of software. This article follows the ad…

Computer-based testing by credentialing agencies has become common; however, selecting a test design is difficult because several good ones are available - parallel forms, computer adaptive (CAT), and multistage (MST). In this study, three computer-based test designs under some common examination conditions were investigated. Item bank size and…

Although some types of inferences are mandatory for readers, predictive inferences (inferences for what will happen next) are generally considered elaborative or optional. Three experiments measuring probe word lexical decision latencies produced evidence for the online generation of predictive inferences during narrative text comprehension.…

Recent structural and functional imaging work, as well as neuropathology and neuropsychology studies, provide strong empirical support for the involvement of frontal cortex in autism. The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a computer-administered set of neuropsychological tests developed to examine specific components…

This article describes the design and development of the International Test Commission's (ITC, this issue) Guidelines for Computer-Based and Internet-Delivered Testing. It examines some of the reasons why the ITC Council decided to invest in a program of research, consultation, and conferences designed to develop internationally agreed-on…

A trial of pen-and-paper and online modes of a computing skills test was conducted for volunteer students of ages 15-16 in New South Wales, Australia. The tests comprised Matching, True/False and 4-option Multiple-Choice items. The aims were to determine whether gender, socio economic status (SES), or the type of item interacted with testing mode.…

Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests. The method resembles Sympson and Hetter's (1985) method of item-exposure control in that the decisions to impose the constraints are probabilistic. The method does not, however, require…

It is unrealistic to suppose that standard item response theory (IRT) models will be appropriate for all the new and currently considered computer-based tests. In addition to developing new models, we also need to give attention to the possibility of constructing and analyzing new tests without the aid of strong models. Computerized adaptive…

Due to the anonymous nature of online courses, many instructors require some type of proctored, comprehensive exam at the conclusion of the course. While comprehensive final exams are not unique to the online classroom, the integration of a proctored, high-stakes assessment helps to ensure that the student registered for a course is actually the…

The purpose of this study was to use a nonexperimental, quantitative design to compare mail and web surveys with survey mode self-selection at two data collection waves. Research questions examined differences and predictabilities among demographics (gender, ethnicity, age, and professional employment) and response quality (pronoun use, item…

People use external knowledge representations (EKRs) to identify, depict, transform, store, share, and archive information. Learning how to work with EKRs is central to becoming proficient in virtually every discipline. As such, EKRs play central roles in curriculum, instruction, and assessment. Five key roles of EKRs in educational assessment are…

To evaluate the value of computer-administered interviews and rating scales, the following topics are reviewed in the present article: (a) strengths and weaknesses of structured and unstructured assessment instruments, (b) advantages and disadvantages of computer administration, and (c) the validity and utility of computer-administered interviews…

TRAILS (Tool for Real-Time Assessment of Information Literacy Skills), is a free online test of student information-handling skills. It was formulated by the Institute for Library and Information Literacy Education and Kent State University Libraries. Based on the Ohio Academic Content Standards and the philosophy of Information Power, it assesses…

The in house development of an online assessment tool, OASIS, has provided a unique opportunity to research the use of online assessment in teaching and learning across the university. The developing relationship between IT staff, educational designers and academics serves as a model for integrated and evolving management systems which demonstrate…

The objectives of this study were to (1) evaluate group differences in specific arithmetic competencies among students with various types of learning difficulties (LD) and (2) to examine the influence of attention behaviors on possible group differences. Participants were a community sample of 291 third- and fourth-grade students with reading…