This paper studied the usefulness of differential item functioning (DIF) methodology for examining potential mode effects. Although the goal was not to validate the comparability of the assessments per se, it is of interest to speculate why some formats could give rise to differential performance. Data were obtained from two instruments on which…

Several methodological problems (particularly the assumed bipolarity of scales, instructions regarding use of the midpoint, and concept-scale interaction) which may contribute to a lack of precision in the semantic differential technique were investigated. Results generally supported the use of the semantic differential. (Author/JKS)

Two local methods for observed-score equating are applied to the problem of equating an adaptive test to a linear test. In an empirical study, the methods were evaluated against a method based on the test characteristic function (TCF) of the linear test and traditional equipercentile equating applied to the ability estimates on the adaptive test…

Two types of computerized testing have been defined: (1) computer-based testing, using a computer to administer conventional tests in which all examinees take the same set of items; and (2) adaptive tests, in which items are selected for administration by the computer, based on examinee's previous responses. This paper discusses an option for…

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…

Current issues in the literature on the testing of linguistic and communicative proficiency are reviewed and discussed in relation to reading comprehension testing. Several theoretical issues in language testing are discussed, including testing purposes and test validity. Areas of concern regarding methods of testing reading comprehension are then…

Describes an interactive computer-testing and record-keeping system that was implemented for a self-paced anatomy and physiology course. Results of exploratory research are reported that focus on student preference for online testing, test anxiety, attitude, and achievement; and suggestions are given for integrating a computer-testing program into…

This study, involving 30 elementary students with learning disabilities, found that students performed significantly better on mathematics tests given using a computer than by paper and pencil. It found no differences among variations of computer-assisted instruction, with either static or animated pictures and either utilizing or not utilizing a…

The No Child Left Behind Act (NCLB) assumes that state-mandated tests provide useful information to school administrators and teachers. However, interviews with administrators and teachers suggest that Minnesota's tests, which are representative of the current generation of state-mandated tests, fail to provide useful information to administrators…

The Educational Testing Service is moving rapidly to computerize its tests for admissions to postsecondary education and occupational licensure/certification. Computerized tests offer important advantages, including immediate score reporting, the convenience of testing when the examinee wishes, and for adaptive tests, equal accuracy throughout the…

The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

The study evaluated the comparability of two versions of a teacher certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). Standardized mean difference (SMD) and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that effect sizes…

This paper describes a computer program in Microsoft BASIC which selects and administers test items from a small item bank. The level of the difficulty of the item selected depends on the test taker's previous response. This adaptive system is based on the Rasch model. The Rasch model uses a unit of measurement based on the logarithm of the…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…

Seven formats of educational testing were compared for student test preferences and how well each evaluated learning. The formats were: (1) true/false; (2) multiple choice; (3) matching; (4) MDT Multiple Digit Testing, in which a machine scores fill-in-the-blanks; (5) fill-in-the-blanks; (6) short answers; and (7) essay. A total of 1,440 survey…