The purpose of this study was to examine individual differences in attitudes toward Audience Response Systems (ARSs) in secondary school classrooms. Specifically, the impact of gender, grade, subject area, computer comfort level, participation level, and type of use were examined in 659 students. Males had significantly more positive attitudes…

This study explores the efforts at Brigham Young University to improve preservice candidates' technology integration using the Teacher Work Sample (TWS) as an assessment tool. Baseline data that was analyzed from 95 TWSs indicated that students were predominantly using technology for productivity and information presentation purposes even though…

Appropriate classroom assessment now tends to utilize formative measures with greater frequency, especially in the early grades and with learner groups at risk of not passing state-mandated standardized tests. Within the authentic context of an action research project, teacher candidates were given handheld computers equipped with data-collection…

This study was an empirical investigation of active student responding (ASR) utilizing a student response system (SRS) vs. single student questioning (SSQ) and no student responding in a graduate level special education class of 23 participants. During the SRS condition, every participant responded to questions using remotes/clickers. During the…

This report presents the results of a research and development effort for SpeechRater? Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language™ (TOEFL®) Practice Online assessment (TPO). The report includes a summary of the validity…

This study is a comparison of 2 versions of an Internet-based tutorial that teaches the behavior-analysis concept of positive reinforcement. A fixed-item group of students studied a version of the tutorial that included 14 interactive examples and nonexamples of the concept. A response-sensitive group of students studied a different version of the…

A number of researchers have suggested that formulaic sequences are stored and processed holistically (Altenberg, 1998; Raupach, 1984; Schmitt & Carter, 2004; Spottl & McCarthy, 2004). However, the evidence for this hypothesis has not been conclusive. The present study examined the representation and processing of formulaic sequences in two online…

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible…

The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

This article examines the nature of confidence in relation to abilities, personality, and metacognition. Confidence scores were collected during the administration of Reading and Listening sections of the Test of English as a Foreign Language Internet-Based Test (TOEFL iBT) to 824 native speakers of English. Those confidence scores were correlated…

The relationship of several individual differences variables to Computer Adaptive Testing (CAT) as compared with traditional written tests are explored. Seven hundred sixty-five examinees took a Computer Adaptive Test and two fixed-length written tests. Each examinee also answered a computer literacy inventory, a satisfaction questionnaire, and a…

This research investigates whether the Computer-Based Academic Assessment System (CAAS), a battery of tests examining speed and accuracy at performing component reading skills, would be useful for identifying reading disability in college students. One important question was whether CAAS could distinguish reading disability from non-disability or…

In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or…

Chang and Zhang (2002, 2003) proposed several baseline criteria for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria were obtained from theoretical derivations that assumed uniformly randomized item selection. The current study investigated potential damage caused…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…