Selective attention has been hypothesized to reduce distractor interference at both perceptual and postperceptual levels (Lavie, 2005), respectively, by focusing perceptual resources on the attended location and by blocking at postperceptual levels distractors that survive perceptual selection. This study measured the impact of load on these…

The two most common models for assessment involve measuring "how well" students perform on a task (the "quality model"), and "how difficult" a task students can succeed on (the "difficulty model"). By exploiting the interactive potential of computers we may be able to use a third model: measuring "how…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

The authors examined whether paper-and-pencil and Web surveys administered in the school setting yield equivalent risk behavior prevalence estimates. Data were from a methods study conducted by the Centers for Disease Control and Prevention (CDC) in spring 2008. Intact classes of 9th- or 10th-grade students were assigned randomly to complete a…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…

Technology has become increasingly saturated into the very fabric of students' daily lives. They are exposed to and use technology in every facet of their lives, including their schoolwork. With millions of dollars being spent by school districts on technology and its infrastructure, this study used an on-line survey to gather data on how teachers…

Recent dual-task studies suggest that a bottleneck prevents central mental operations from working on more than one task at a time, especially at relatively low practice levels. It remains highly controversial, however, whether this bottleneck is structural (inherent to human cognitive architecture) or merely a strategic choice. If the strategic…

The recent literature on computerized adaptive testing (CAT) has developed methods for creating CAT item pools from a large master pool. Each CAT pool is designed as a set of nonoverlapping forms reflecting the skill levels of an assumed population of test takers. This article presents a Monte Carlo method to obtain these CAT pools and discusses…

Technology is transforming many aspects of society including the ways teachers teach and students learn. Although technology has been firmly established as a teaching tool across a range of content areas, educators are realizing that technology also offers innovative ways to help their students take standardized tests that comply with the mandates…

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and…

Item selection is a core component in computerized adaptive testing (CAT). Several studies have evaluated new and classical selection methods; however, the few that have applied such methods to the use of polytomous items have reported conflicting results. To clarify these discrepancies and further investigate selection method properties, six…

There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems…

Previous research has shown that rapid-guessing behavior can degrade the validity of test scores from low-stakes proficiency tests. This study examined, using hierarchical generalized linear modeling, examinee and item characteristics for predicting rapid-guessing behavior. Several item characteristics were found significant; items with more text…

This article analyzes the findings from an 18-section experiment studying the effect of homework-completion tutoring on community college students' remedial mathematics performance. The experiment involved 529 students registered for two remedial math courses: math skills and algebra. For each course, the experiment studied nine sections: three…

How do people select among different strategies to accomplish a given task? Across disciplines, the strategy selection problem represents a major challenge. We propose a quantitative model that predicts how selection emerges through the interplay among strategies, cognitive capacities, and the environment. This interplay carves out for each…