In recent years, the Educational Testing System organisation has developed two models of the computer-based Test of English as a Foreign Language (TOEFL). However, the computerization of the test has shown a number of problems according to the testees' origin. This paper suggests some of these problems after conducting short interviews with four…

In providing an alternative view to the previous article by Ward (TM 508 880), the author notes problems associated with adaptive testing, diagnostic testing, testing embedded in instruction, and testing through simulations. (BW)

Computer-based testing places great burdens on all involved parties to ensure test security. A task analysis of test site security might identify the areas of protecting the test, protecting the data, and protecting the environment as essential issues in test security. Protecting the test involves transmission of the examinations, identifying the…

In this series of studies, we investigated the technical adequacy of three curriculum-based measures used as benchmarks and for monitoring progress in three critical reading- related skills: fluency, reading comprehension, and vocabulary. In particular, we examined the following easyCBM measurement across grades 3-7 at fall, winter, and spring…

Technology has become increasingly saturated into the very fabric of students' daily lives. They are exposed to and use technology in every facet of their lives, including their schoolwork. With millions of dollars being spent by school districts on technology and its infrastructure, this study used an on-line survey to gather data on how teachers…

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and…

There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems…

Previous research has shown that rapid-guessing behavior can degrade the validity of test scores from low-stakes proficiency tests. This study examined, using hierarchical generalized linear modeling, examinee and item characteristics for predicting rapid-guessing behavior. Several item characteristics were found significant; items with more text…

This article analyzes the findings from an 18-section experiment studying the effect of homework-completion tutoring on community college students' remedial mathematics performance. The experiment involved 529 students registered for two remedial math courses: math skills and algebra. For each course, the experiment studied nine sections: three…

How do people select among different strategies to accomplish a given task? Across disciplines, the strategy selection problem represents a major challenge. We propose a quantitative model that predicts how selection emerges through the interplay among strategies, cognitive capacities, and the environment. This interplay carves out for each…

An effect size of about 0.70 (or 0.40-0.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K-12 were reviewed. Many of the studies had severely flawed research designs yielding…

The second national sample assessment of Information and Communication Technology (ICT) literacy at Year 6 and Year 10 will occur in 2008. The assessment happens every three years and the first occurred in 2005. This document provides information about the ICT literacy assessment including: (1) Education Ministers' decisions regarding ICT; (2) the…

This paper reports analysis of 2006-2007 on-entry assessment data from the Performance Indicators in Primary Schools Baseline Assessment (PIPS-BLA) of random samples of students in England, Scotland, New Zealand and Australia. The analysis aimed, first, to investigate the validity and reliability of that instrument across countries and sexes, and,…

In recent years, computer-based testing (CBT) has grown in popularity, is increasingly being implemented across the United States, and will likely become the primary mode for delivering tests in the future. Although CBT offers many advantages over traditional paper-and-pencil testing, assessment experts, researchers, practitioners, and users have…

This book provides a general overview of computer based testing (CBT) and aims at an audience of practitioners and graduate students. The book discusses all aspects of BT without going into psychometric detail. This nontechnical and basic book is recommended as a textbook for students or new researchers. (SLD)