Describes a study of undergraduates that was conducted to examine the equivalence of the mode of administration using the paper-pencil and computer-based versions of the Strong-Campbell Interest Inventory. Differences in scores are discussed, time taken for the inventories is studied, and further research is suggested. (Contains 16 references.)…

Time limits on some computer-adaptive tests (CATs) are such that many examinees have difficulty finishing, and some examinees may be administered tests with more time-consuming items than others. Results from over 100,000 examinees suggested that about half of the examinees must guess on the final six questions of the analytical section of the…

Eighty-three Test of English as a Foreign Language (TOEFL) writing prompts administered via computer-based testing between July 1998 and August 2000 were examined for differences attributable to the response mode (handwriting or word processing) chosen by examinees. Differences were examined statistically using polytomous logistic regression. A…

The degree to which item review on a computerized adaptive test (CAT) could be used by examinees to inflate their scores artificially was studied. G. G. Kingsbury (1996) described a strategy in which examinees could use the changes in item difficulty during a CAT to determine which items' answers are incorrect and should be changed during item…

More attention is currently being paid to the distractors of a multiple-choice test item (Thissen, Steinberg, and Fitzpatrick, 1989). A systematic relationship exists between the keyed response and distractors in multiple-choice items (Levine and Drasgow, 1983). New scoring methods have been introduced, computer programs developed, and research…

The Computerized Adaptive Screening Test (CAST) was developed to provide an estimate at recruiting stations of prospects' Armed Forces Qualification Test (AFQT) scores. The CAST was designed to replace the paper-and-pencil Enlistment Screening Test (EST). The initial validation study of CAST indicated that CAST predicts AFQT at least as accurately…

This study investigated specific conditions under which out-of-scale information improves measurement precision and the factors that influence the degree of reliability gains and the amount of bias induced in the reported scores when out-of-scale information is used. In-scale information is information that an item provides for a composite trait…

The purpose of this study was to determine if a relationship exists between scores and the times that medical students choose to take a computer-administered test. The results indicate that students who choose to take a test later within a given time period tend to perform less well than students who take the test earlier. Although the magnitude…

An essay test is now an integral part of the computer based Test of English as a Foreign Language (TOEFL-CBT). This paper provides a brief overview of the current TOEFL-CBT essay test, describes the operational procedures for essay scoring, including the Online Scoring Network (OSN) of the Educational Testing Service (ETS), and discusses major…

A computer-administered (CA) form of the Multidimensional Personality Questionnaire (MPQ) (A. Tellegen, 1982) was created, and scores of 126 college students were compared to those of 101 who took a paper-and-pencil MPQ. Multivariate analyses found no group differences for the CA format, and likelihood of profile validity was decreased. Results…

Simulated data were used to investigate the performance of modified versions of the Mantel-Haenszel method of differential item functioning (DIF) analysis in computerized adaptive tests (CAT). Results indicate that CAT-based DIF procedures perform well and support the use of item response theory-based matching variables in DIF analysis. (SLD)

The speech of a sample of Chinese and Korean nonnative speakers of English (n=30) was evaluated by raters of the Speaking Proficiency English Assessment Kit (SPEAK) for a degree of fluency and by a computerized silent-pause-detection program. (35 references) (JL)

This study examined whether a teacher-paced video (TPV) accommodation or a student-paced computer (SPC) accommodation provided differential access for student with disabilities versus their general education peers on a large-scale math test. It found that although both pacing accommodations significantly influenced mean scores, the SPC…

This study investigated the statistical and practical significance of context effects for items randomized within testlets for administration during a series of computerized non-adaptive tests. One hundred and twenty-five items from four primary school reading tests were studied. Logistic regression analyses identified from one to four items for…

In 2004 Embry-Riddle Aeronautical University transitioned from proctored examinations for distance learning courses to online examinations that are not proctored. The purpose of this study was to determine if there is a significant difference in the midterm and final examination grades between proctored and non-proctored online examinations. Three…