To determine the relative reliabilities and validities of paper-based and computer-based measurement procedures, 83 male student pilots and radar intercept officers were administered computer and paper-based tests of aircraft recognition. The subject matter consisted of line drawings of front, side, and top silhouettes of aircraft. Reliabilities…

Evaluating the comparability of a test administered in different languages is a difficult, if not impossible, task. Comparisons are problematic because observed differences in test performance between groups who take different language versions of a test could be due to a difference in difficulty between the tests, to cultural differences in test…

The Law School Admission Council (LSAC) is currently investigating the feasibility and advisability of administering a computerized Law School Admission Test (LSAT). In this context, using data from the College Boards 1989 National Advanced Placement (AP) Chemistry Examination for 18,462 test takers and a survey of all AP Chemistry teachers in…

The accuracy with which expert systems (ESs) score a new nonmultiple-choice free-response test item was investigated, using 734 high school students who were administered an advanced-placement computer science examination. ESs produced scores for 82 percent to 95 percent of the responses and displayed high agreement with a human reader on the…

Technology today offers many new opportunities for innovation in educational assessment through rich new assessment tasks and potentially powerful scoring, reporting and real-time feedback mechanisms. One potential limitation for realizing the benefits of computer-based assessment in both instructional assessment and large scale testing comes in…

A new free-response item type for mathematics tests is described. The item type, referred to as the Student-Produced Response (SPR), was first introduced into the Preliminary Scholastic Aptitude Test/National Merit Scholarship Qualifying Test in 1993 and into the Scholastic Aptitude Test in 1994. Students solve a problem and record the answer by…

A study at Brigham Young University (Utah) investigated the feasibility of computer-assisted language placement testing in higher education. Benefits and problems of this approach for test administration, individualization of item selection, and recordkeeping were examined. Four steps were followed in production of a test for Spanish placement:…

This study examined computerized adaptive testing and cognitive ability testing of adults with cognitive disabilities. Adult subjects (N=250) were given computerized tests on language usage and space relations in one of three administration conditions: paper and pencil, fixed length computer adaptive, and variable length computer adaptive.…

The use of optical scanners and computers in educational testing is common where objective testing methods (such as true-false, matching, and multiple-choice items) are well-established means of evaluating educational achievement. Where non-objective testing methods (such as fill-in-the-blank, short-answer, and essay items) have been more common,…

This report updates and summarizes what is known from research on the effects of test accommodations for students with disabilities and also provides direction to the design of critically needed future research on accommodations. A review was conducted of 46 empirical research studies on accommodations published from 1999 through 2001. The…

Seven formats of educational testing were compared according to student preferences/perceptions of how well each test method evaluates learning. Formats compared include true/false, multiple-choice, matching, multi-digit testing (MDT), fill-in-the-blank, short answer, and essay. Subjects were 1,440 university students. Results indicate that tests…

Reports a study to explore student's computational performance on computer-administered testing situations while at the computer. Students from grades 3-6 (n=100) were randomly assigned to treatment order, computer assessment first or paper/pencil assessment first. Significant differences occurred in three areas: completion time, number of mental…

Examined attitudes toward taking different formats of oral proficiency assessments across three languages: Spanish, Arabic, and Chinese. Students were administered both the tape-mediated Simulated Oral Proficiency Interview (SOPI) and a new Computerized Oral Proficiency Instrument (COPI). Questionnaire responses showed examinees, particularly…

As GED (General Educational Development) Testing Service considers the feasibility of a computer administration of the GED Tests, one issue being considered is the difference in costs of supplying only a computer-based format vs. offering both computer-based and paper formats of the GED Tests. A significant concern then arises as to whether…

This study assessed whether providing examinees with a choice between computerized adaptive testing (CAT) and self-adaptive testing (SAT) affects test performance in comparison with being assigned a CAT or SAT, and evaluated variables influencing examinee choice of either test form. The relative influences of test type and test choice on examinee…