This study conducted a meta-analysis of computer-based and paper-and-pencil administration mode effects on K-12 student mathematics tests. Both initial and final results based on fixed- and random-effects models are presented. The results based on the final selected studies with homogeneous effect sizes show that the administration mode had no…

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

Content balancing is an important issue in the design and implementation of computerized adaptive testing (CAT). Content-balancing techniques that have been applied in fixed content balancing, where the number of items from each content area is fixed, include constrained CAT (CCAT), the modified multinomial model (MMM), modified constrained CAT…

This study examined possible relationships between cognitive ability, teacher dispositions, and content knowledge and elementary classroom achievement. Data was gathered on teachers using the Wonderlic Personnel Test(TM), Star Teacher Pre-Screener(TM) and Praxis II(TM) assessments and compared to classroom growth on the Measurement of Adaptive…

In today's society, writing with paper and pencil has largely been replaced by writing using a computer. Students are expected to compose on a computer as they move through school and into the workforce. Reflecting the changes in technology, eighth- and twelfth-grade students taking the National Assessment of Educational Progress (NAEP) writing…

Utilizing empirical data from an online satisfaction survey of over ten thousand full-time, pre-tenure (tenure -track) faculty members at 120 institutions, as well as qualitative data from interviews with seventy-three faculty and administrators at six research universities, this paper highlights the most important factors in the success and…

This study piloted test items that will be used in a computer-delivered and scored test of productive grammatical ability in English as a second language (ESL). Findings from research on learners' development of morphosyntactic, syntactic, and functional knowledge were synthesized to create a framework of grammatical features. We outline the…

Objective: Negative priming (NP) is the slowed response to a stimulus that was previously ignored. Response times in NP task conditions were compared with the interference provided by congruent/incongruent stimuli in a Stroop condition in the same task in children diagnosed with attention-deficit hyperactivity disorder (ADHD), their unaffected…

Presents the preliminary results of a comparison of Computerized Adaptive Testing (CAT) and conventional testing of English competency for students with limited English proficiency. The CAT procedure, which uses computers and a measurement theory known as Item Response Theory (IRT), provides several benefits that traditional paper and pencil…

The IBT TOEFL has become the principal example of online high stakes language testing since 2005. Most instructors who do the preparation for IBT TOEFL face two main realities: first, students are eager and highly motivated to take the test because of the prospective implications; and, second, specific studies would be necessary to see if…

Computer-based assessment appears to offer the promise of radically improving both how assessments are implemented and the quality of the information they can deliver. However, as many states consider whether to embrace this new technology, serious concerns remain about the fairness of the new systems and the readiness of states (and districts and…

The information and assessment materials in these resources have been designed to assist teachers to gauge their own students' proficiency in Information and Communication Technologies (ICT) literacy. By examining modules from the National Year 6 and Year 10 ICT Literacy Assessment teachers may be able to design similar tasks and to judge their…

The main objective of this paper is to examine the effectiveness of computer-assisted formative assessment in a large, first-year undergraduate geography course. In particular, the paper evaluates the impact of computer-assisted multiple-choice practice tests on student performance in the course as well as student opinions of this type of…

Computerized adaptive testing (CAT) has unsurpassable advantages over traditional testing. It has become the mainstream in large scale examinations in modern society. This paper gives a brief introduction to CAT including differences between traditional testing and CAT, the principles of CAT, psychometric theory and computer algorithms of CAT, the…

Many challenges exist for high-stakes testing programs offering continuous computerized administration. The automated assembly of test questions to exactly meet content and other requirements, provide uniformity, and control item exposure can be modeled and solved by mixed-integer programming (MIP) methods. A case study of the computerized…