Computerized-adaptive (CAT) and self-adapted (SAT) music listening tests were compared for efficiency, reliability, validity, and motivational benefits with 53 junior high school students. Results demonstrate trade-offs, with greater potential motivational benefits for SAT and greater efficiency for CAT. SAT elicited more favorable responses from…

This report provides a two-part evaluation of the IntelliMetric[SM] automated essay scoring system based on its performance scoring essays from the Analytic Writing Assessment of the Graduate Management Admission Test[TM] (GMAT[TM]). The IntelliMetric system performance is first compared to that of individual human raters, a Bayesian system…

This paper describes a study in which a Picture Readability Index (PRI) was used to investigate initial and extended perceptions of photographs. Readability criteria for evaluating instructional text seems to have been in place for a long time, yet instructional visuals like photographs and illustrations have typically been subject to no such…

Multilog (Thissen, 1991) was used to estimate parameters of 225 items from the Quebec Adaptive Behavior Scale (QABS). A database containing actual data from 2,439 subjects was used for the parameterization procedures. The two-parameter-logistic model was used in estimating item parameters and in the testing strategy. MicroCAT (Assessment Systems…

Two courses on logic gates were administered to 1,191 male and female recruits in Basic Military Training in 3 studies (448, 431, and 312 subjects, respectively) to evaluate the relative validities of the Armed Services Vocational Aptitude Battery (ASVAB) and the Learning Abilities Measurement Program (LAMP) tests in predicting individual…

The rule space model permits measurement of cognitive skill acquisition, diagnosis of cognitive errors, and detection of the strengths and weaknesses of knowledge possessed by individuals. Two ways to classify an individual into his or her most plausible latent state of knowledge include: (1) hypothesis testing--Bayes' decision rules for minimum…

This paper introduces a probabilistic model that is capable of diagnosing and classifying cognitive errors in a general problem-solving domain. Item response theory is used to deal with the variability of response errors. Responses from a 38 item fraction addition test given to 595 junior high school students are used to illustrate the model.…

The differences in types of information-processing skills developed by different instructional backgrounds affect, negatively or positively, the learning of further advanced instructional materials. If prior and subsequent instructional methods are different, a proactive inhibition effect produces low achievement scores on a post test. This poses…

This report is the Proceedings of the third conference of its type. Included are 23 of the 25 papers presented at the conference, discussion of these papers by invited discussants, and symposium papers by a group of leaders in adaptive testing and latent trait test theory research and applications. The papers are organized into the following…

This report presents data concerning the validity of a set of experimental computerized and paper-and-pencil tests for measures of on-job performance on global and job elements. It reports on the usefulness of 30 experimental and operational variables for predicting marks on 42 job elements and on a global criterion for Electrician's Mate,…

Reports on a study designed to determine whether or not biology students were being disadvantaged by taking computer tests instead of written paper forms of the same tests. Results indicated that mean scores on computer-administered and written forms of the same test were approximately equivalent. (TW)

Inconsistencies in scores from computer-simulated and "hands-on" science performance assessments have led to questions about the exchangeability of these two methods in spite of the highly touted potential of computer-simulated performance assessment. This investigation considered possible explanations for students' inconsistent performances: (1)…

Discussion of the display of instructional text and text format elements focuses on a study of fourth graders that was conducted to test the effects of plain and enhanced screen designs on learning and time during computer-assisted instruction (CAI). Implications for screen design and future research are suggested. (31 references) (LRW)

Implications of case specificity in two computer-based clinical-simulation examination cases were examined by a classical measurement approach and by a Bayesian analysis of test characteristics. Results from 163 medical students indicate that such examinations cannot be used in high-stakes situations without additional research. (SLD)

The Microcomputer Adaptive Testing High-Risk-Urban Students (MATH-R-US) project made computerized assessment an integral part of remedial high school mathematics at an inner-city school with predominantly African-American students. Results suggest that the girls exhibited greater self-esteem toward using computers than did boys and that…