The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

The reliability of four branching algorithms commonly used in computer adaptive testing (CAT) was examined. These algorithms were: (1) maximum likelihood (MLE); (2) Bayesian; (3) modal Bayesian; and (4) crossover. Sixty-eight undergraduate college students were randomly assigned to one of the four conditions using the HyperCard-based CAT program,…

Responses to previously calibrated items administered in a computerized adaptive testing (CAT) mode may be used to recalibrate the items. This live-data simulation study investigated the possibility, and limitations, of on-line adaptive recalibration of precalibrated items. Responses to items of a Rasch-based paper-and-pencil licensure examination…

This document collects five presentations in the field of vocational counseling and guidance. Its aim is to share research reports with vocational counselors, enhancing the level of this service in Canada. In the first paper, Benjamin Gottlieb discusses social networks and the gestalt of help-seeking, pointing out that persons are attached to…

This paper is the final report of a multi-year project sponsored by the Office of Naval Research (ONR) in 1987 through 1990. The main objectives of the research summarized were to: investigate the non-parametric approach to the estimation of the operating characteristics of discrete item responses; revise and strengthen the package computer…

Conventional mastery tests designed to make optimal mastery classifications were compared with fixed-length and variable-length adaptive mastery tests. Comparisons between the testing procedures were made across five content areas in an introductory biology course from tests administered to volunteers. The criterion was the student's standing in…

The Broad-Range Tailored Test (BRTT) is a computerized adaptive test. Each testee responds to 25 items; at the conclusion of the test the computer calculates a verbal ability score for the individual. The test was designed to yield a verbal ability score from the fifth grade level to the graduate school level. Two forms of the BRTT were…

Volunteer college students were assigned to one of six computer administered vocabulary tests, one half with immediate knowledge of results (KR) after responding to each item, and the other half without knowledge of results. The six tests were designed to be at one of three levels of difficulty and consisted either of 50 preselected items…

A study involving four sections of a general psychology course at Delta College (Michigan) was conducted to determine: (1) the effectiveness of repeated, cumulative testing on long-term retention of information; (2) its effect on students' ability to generalize information learned as measured by the College Level Examination Program (CLEP) general…

A computerized adaptive testing model was applied to a hierarchically arranged series of subtests within the instructional context of a technical education system. The model was a modification of Lord's flexilevel paradigm; however, it did not allow for individualized entry. Two achievement tests, each divided into five hierarchically related…

The study investigated the effects of exposure to computer-assisted testing (CAT) as an effective instructional method and its effects on attitudes toward computer-assisted instruction (CAI). Five computer quizzes consisting of 20 randomly drawn multiple-choice questions were individually administered on 10 teletype terminals. A feedback mechanism…

The effects of providing immediate knowledge of results (KR) and adaptive testing on test anxiety and test-taking motivation were investigated. Also studied was the accuracy of student perceptions of the difficulty of adaptive and conventional tests administered with or without immediate knowledge of results. Testees were 350 college students…

The assessment framework underlying a science performance monitoring program is process-oriented and intended to appeal to generalizability theory for a suitable estimation paradigm. Preliminary applications are described. Results suggest that computerized question-banking, domain-sampling of questions, and generalizablity theory together provide…

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…

The availability of item response times made possible by computerized testing represents an entirely new type of information about test items. This study explores the issue of how to represent response-time information in item banks. Empirical response-time distribution functions can be fit with statistical distribution functions with known…