This paper reviews the role of ICT-based assessment in the light of the growing use of virtual learning environments in universities. Issues of validity, efficiency, type of response, and scoring are addressed. A major area of research is the automated scoring of text. Claims for automated formative assessment are queried, since the feedback of…

In this study, 5,257employees provided upward feedback ratings for 759 target managers who had the option of having their subordinates rate them using a traditional paper-and-pencil (opscan) response mode or using the company's intranet. Preliminary analyses showed mean online ratings were more favorable than were mean paper-and-pencil ratings (d…

The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models…

The role of pupil assessment in ICT is often seen by teachers as problematic. This article will explore the relationship of the two and will argue that research in assessment has not kept up with the opportunities offered by ICT. Conversely, some of the new developments in "assessment for learning" have not yet found their way into ICT.…

Eighty-three Test of English as a Foreign Language (TOEFL) writing prompts administered via computer-based testing between July 1998 and August 2000 were examined for differences attributable to the response mode (handwriting or word processing) chosen by examinees. Differences were examined statistically using polytomous logistic regression. A…

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

Because technology is more prevalent and accessible for use in assessment, this article highlights what counselors and educators need to know when considering the use of computers and the Internet for that purpose. The article concludes with some predictions on how technology might influence assessment and accountability in the future. This…

With the growing demand for and use of computer-based language tests (CBLTs) comes the need for clear guidelines to help educators as they attempt to select appropriate tests to assess their students with respect to their second- and foreign-language (L2/FL) teaching-learning goals. The purpose of this article is to provide guidelines to educators…

Faculty teaching distance courses continuously seek ways to maximize learning for students. Two practice with feedback strategies were examined in this study for their impact on students' achievement and attitudes in an upper-division university level web-based course. One format contained higher structure and dialog creating lower transactional…

The increased use of computer-based and Internet-delivered testing has raised a number of ethical and legal issues. The International Test Commission's (this issue) Guidelines for Computer-Based and Internet-Delivered Testing represent the most recent attempt to provide test users, publishers, and developers with guidance regarding the appropriate…

This study applied the maximum expected information (MEI) and the maximum posterior-weighted information (MPI) approaches of computer adaptive testing item selection to the case of a test using polytomous items following the partial credit model. The MEI and MPI approaches are described. A simulation study compared the efficiency of ability…

Computerized multistage testing (MST) designs require sets of test questions (testlets) to be assembled to meet strict, often competing criteria. Rules that govern testlet assembly may dictate the number of questions on a particular subject or may describe desirable statistical properties for the test, such as measurement precision. In an MST…

This study assessed the hypothesis that the response time to an item increases as the positions of the item and the respondent on the continuum of the trait that is measured draw closer together. This hypothesis has previously been stated by several authors, but so far it does not seem to have been empirically assessed in a rigorous way. A…

With the introduction of online course surveys comes the related issue of reporting survey results. This article is based on the experiences of Georgia Institute of Technology in Atlanta (Georgia Tech), a large, Doctoral/Research-Extensive institution where all end-of-term course surveys have been online since the fall semester of 1999. This…

The author explores current efforts by educators and policy makers to harness the power of educational technology for both assessment "of learning" and assessment "for learning" in K-12 classrooms. (Contains 1 figure.)