The attractiveness of computer-based tests (CBTs) is due largely to their capability to expand the ways we conduct testing. A relatively unexplored application, however, is actively using the computer to reduce construct-irrelevant variance while a test is being administered. This investigation introduces the effort-monitoring CBT, in which the…

The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

This paper is the final report of a multi-year project sponsored by the Office of Naval Research (ONR) in 1987 through 1990. The main objectives of the research summarized were to: investigate the non-parametric approach to the estimation of the operating characteristics of discrete item responses; revise and strengthen the package computer…

To determine the relative reliabilities and validities of paper-based and computer-based measurement procedures, 83 male student pilots and radar intercept officers were administered computer and paper-based tests of aircraft recognition. The subject matter consisted of line drawings of front, side, and top silhouettes of aircraft. Reliabilities…

Conventional mastery tests designed to make optimal mastery classifications were compared with fixed-length and variable-length adaptive mastery tests. Comparisons between the testing procedures were made across five content areas in an introductory biology course from tests administered to volunteers. The criterion was the student's standing in…

A computerized adaptive testing model was applied to a hierarchically arranged series of subtests within the instructional context of a technical education system. The model was a modification of Lord's flexilevel paradigm; however, it did not allow for individualized entry. Two achievement tests, each divided into five hierarchically related…

This report examines how selection fairness is influenced by the characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, degree of item bias, and testing strategy. Computer simulation was used in the administration of either a conventional or Bayesian adaptive ability test to a…

Two types of computer-administered unit quizzes in a systematic pathology course for second-year medical students were compared. Quizzes composed of questions selected on the basis of a student's ability had higher correlations with the final examination than did quizzes composed of questions randomly selected from topic areas. (Author/JAZ)

Evaluating the comparability of a test administered in different languages is a difficult, if not impossible, task. Comparisons are problematic because observed differences in test performance between groups who take different language versions of a test could be due to a difference in difficulty between the tests, to cultural differences in test…

Discussion of the use of microcomputers in education focuses on the use of microcomputers for evaluation purposes. A study that collected performance data on both college students and the evaluation instrument is described, reliability and validity of the test are discussed, and the use of microcomputers to redesign instructional systems is…

Provides reviews of computerized scoring and interpretive systems for the Minnesota Multiphasic Personality Inventory (MMPI-2 and MMPI-A): Caldwell Report, the Psychological Assessment Resources MMPI-2 Interpretive System, and the National Computer Systems Programs. Concludes that when used appropriately, such scoring systems enhance a counselor's…

Four studies involving a total of 150 college students, a junior high school student, and a high school student are presented that evaluate the validity of the Computer-based Academic Assessment system (CAAS) as a diagnostic technique for identifying specific reading disabilities in college students. Results show that the CAAS meets the criteria…

The increasing availability and performance of computer-based testing has prompted more research on the automatic assessment of language and speaking proficiency. In this investigation, we evaluated the feasibility of using an off-the-shelf speech-recognition system for scoring speaking prompts from the LanguEdge field test of 2002. We first…

A study at Brigham Young University (Utah) investigated the feasibility of computer-assisted language placement testing in higher education. Benefits and problems of this approach for test administration, individualization of item selection, and recordkeeping were examined. Four steps were followed in production of a test for Spanish placement:…

This manual is a guide to the Work Temperament Inventory (WTI), a self-report measure of 12 work temperaments that were originally identified and defined by the U.S. Department of Labor. The WTI consists of 134 items requiring a simple "like" or "dislike" response and a reading level of seventh grade. It can be completed in 15…