To explore whether different balances of fiction/non-fiction reading and challenge might help explain differences in reading achievement between genders, data on 45,670 pupils who independently read over 3 million books were analysed. Moderate (rather than high or low) levels of challenge were positively associated with achievement gain, but…

This study explores the potential for using a computer-based scoring procedure for the formulating-hypotheses (F-H) item. This item type presents a situation and asks the examinee to generate explanations for it. Each explanation is judged right or wrong, and the number of creditable explanations is summed to produce an item score. Scores were…

The relationship of several individual differences variables to Computer Adaptive Testing (CAT) as compared with traditional written tests are explored. Seven hundred sixty-five examinees took a Computer Adaptive Test and two fixed-length written tests. Each examinee also answered a computer literacy inventory, a satisfaction questionnaire, and a…

The average Kullback-Keibler (K-L) information index (H. Chang and Z. Ying, in press) is a newly proposed statistic in Computerized Adaptive Testing (CAT) item selection based on the global information function. The objectives of this study were to improve understanding of the K-L index with various parameters and to compare the performance of the…

This study focused on the robustness of unidimensional item response theory (UIRT) models in computerized classification testing against violation of the unidimensionality assumption. The study addressed whether UIRT models remain acceptable under various testing conditions and dimensionality strengths. Monte Carlo simulation techniques were used…

This research investigates whether the Computer-Based Academic Assessment System (CAAS), a battery of tests examining speed and accuracy at performing component reading skills, would be useful for identifying reading disability in college students. One important question was whether CAAS could distinguish reading disability from non-disability or…

When items are selected during a computerized adaptive test (CAT) solely with regard to their measurement properties, it is commonly found that certain items are administered to nearly every examinee, and that a small number of the available items will account for a large proportion of the item administrations. This presents a clear security risk…

In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or…

The purpose of many certification or licensure tests is to identify candidates who possess some level of minimum competence to practice their profession. In general, this type of test is referred to as classification testing. When this type of test is administered with a computer, the test is a computerized classification test (CCT). This paper…

Chang and Zhang (2002, 2003) proposed several baseline criteria for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria were obtained from theoretical derivations that assumed uniformly randomized item selection. The current study investigated potential damage caused…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

The described program was designed to capitalize on state-of-the-art technologies in computer-aided testing to develop accurate measures of psychomotor ability (eye-hand coordination) and then to investigate different ways to use these psychomotor measures in the selection of pilot training candidates. This report documents the validation of two…

Computer-adaptive testing (CAT) allows improved security, greater scoring accuracy, shorter testing periods, quicker availability of results, and reduced guessing and other undesirable test behavior. Simple approaches can be applied by the classroom teacher, or other content specialist, who possesses simple computer equipment and elementary…

Nine methods for automated test construction are described. All are based on the concepts of information from item response theory. Two general kinds of methods for the construction of parallel tests are presented: (1) sequential test design; and (2) simultaneous test design. Sequential design implies that the tests are constructed one after the…

This procedure for testing the mastery of programming skills uses online testing and correction. The student is presented with a test problem and is asked to solve it, encode the solution, debug the code, and save it on a floppy disk. The instructor corrects the program at the appropriate points through the use of REM statements. The erroneous or…