David Foster is the founder of Kryterion, an Internet test administration company, and currently serves there as chief scientist and executive vice president. He is the author of numerous articles for industry trade journals and textbooks and sits on the Council for the International Test Commission. In this interview, Foster talks about his…

The aim of the present research was to compare the use of multiple-choice questions (MCQs) as an examination method, to the examination based on constructed-response questions (CRQs). Despite that MCQs have an advantage concerning objectivity in the grading process and speed in production of results, they also introduce an error in the final…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

The national certification tests and entrance examinations are the most important tests for proving the ability or knowledge level of a person. To accurately evaluate the professional skills or knowledge level, the composed test sheets must meet multiple assessment criteria such as the ratio of relevant concepts to be evaluated and the estimated…

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

Purpose: The purpose of this paper is to describe how and why Texas A&M University at Qatar (TAMUQ) has developed a system aiming to effectively place students in freshman and developmental English programs. The placement system includes: triangulating data from external test scores, with scores from a panel-marked hand-written essay (HWE),…

Within large scale educational assessment agencies in the UK, there has been a shift towards assessors marking digitally scanned copies rather than the original paper scripts that were traditionally used. This project uses extended essay examination scripts to consider whether the mode in which an essay is read potentially influences the…

The University entrance examination (PAU) is the most important high-stakes exam in the General educational system in Spain. It has 6 sections of which the Foreign Language one is very relevant to the final score. The English section has had almost not significant changes in the last 20 years despite all the research in language learning and…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

Elements of network-based assessment systems are envisioned based on recent advances in knowledge and practice in learning theory, assessment design and delivery, and semantic web interoperability. The architecture takes advantage of the meditating role of technology as well as recent models of assessment systems. This overview of the elements…

Presents two views of the place of technology in the National Standards Project, which aims to establish a national examination system to improve the performance of U.S. school children. Standards to promote technological literacy, the use of technology to assess performance, and the timetable for setting standards are discussed. (KRN)

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

According to the Committee on the Foundations of Educational Assessment, traditional educational assessment does a reasonable job of measuring knowledge of basic facts, procedures and proficiency of an area of the curriculum. However, the traditional approach fails to capture the breadth and richness of knowledge and cognition. Such a concern…

This digest focuses on going beyond multiple choice testing to the development of methods for assessing complex knowledge and performances. Newly designed assessment systems must accurately measure and promote the complex thinking and learning goals that are known to be critical to students' academic success and their eventual sustained…

As everyone enters the 21st Century there is a great deal of discussion in business and education circles alike about the type of skills the youth will need to survive and thrive in this century. At the same time, there is little known today about the level of 21st Century skills students currently have. In part this is because, as a nation,…