This article describes a general item response theory-based factor analytic procedure that allows assessment of the equivalence between 2 administrative modes of a questionnaire: paper and pencil, and Internet based. The theoretical relations between the present procedure and other methods used in previous empirical research are shown, and the…

Elements of network-based assessment systems are envisioned based on recent advances in knowledge and practice in learning theory, assessment design and delivery, and semantic web interoperability. The architecture takes advantage of the meditating role of technology as well as recent models of assessment systems. This overview of the elements…

In this study, we examined the characteristics of reading disability (RD) in the seventh grade of the Greek educational system and the corresponding diagnostic practice. We presented a clinically administered assessment battery, composed of typically employed tasks, and a fully automated, computer-based assessment battery that evaluates some of…

Combining psycholinguistic technologies and systems analysis created advances in motivational profiling and numerous new behavioral engineering applications. These advances leapfrog many mainstream statistical research methods, producing superior research results via cause-effect language mechanisms. Entire industries explore motives ranging from…

This study evaluated a "substantively driven" method for scoring NAEP writing assessments automatically. The study used variations of an existing commercial program, e-rater[R], to compare the performance of three approaches to automated essay scoring: a "brute-empirical" approach in which variables are selected and weighted solely according to…

From 2005 to 2008, the International Development Research Centre (IDRC) is funding a series of distance education (DE) studies in its Pan Asia Networking (PAN) region. Eight collaborative projects are under way in Bhutan, Cambodia, China, Hong Kong, India, Indonesia, Laos, Mongolia, Pakistan, the Philippines, Sri Lanka, Thailand, and Viet Nam. The…

This simulation study involved the design of two two-stage tests in which the routing tests and the second-stage measurement testlets took the form of a multidimensional knapsack problem with prespecified target informations and constraints to be enumerated using the algorithm of E. Balas. Two conventional tests of similar length to the two-stage…

The United States Armed Services are planning to introduce computerized adaptive testing (CAT) into the Armed Services Vocational Aptitude Battery (ASVAB), which is a major part of the present personnel assessment procedures. Adaptive testing will improve efficiency greatly by assessing each candidate's answers as the test progresses and posing…

MARC (Methodical Assessment of Reports by Computer) is a report-marking program which enables teachers to provide individualized feedback on reports written by engineering students. The MARC system is objective in its consistent application of the same programed criteria, but also allows individual markers to supply their own comments as required.…

Describes evolving trends in testing, including such topics as formative versus summative evaluations; the use of tests as a guide to instructional decision making; the need to focus on higher level cognitive skills; and the role of computers in testing. An annotated bibliography lists 10 relevant journal articles. (CLB)

There are a variety of situations in which low-stakes achievement tests--which are defined as those having few or no consequences for examinee performance--are used in applied measurement. A problem inherent in such testing is that we often cannot assume that all examinees give their best effort to their test, which suggests that the test scores…

This book profiles how computer-assisted assessment can help both staff and students by drawing on the experience and expertise of practitioners, in the United Kingdom and internationally, who are already using computer-assisted assessment. The publication is organized into three main sections--"Pragmatics and Practicalities of CAA,""Using CAA for…

The criticism that language materials often test rather than teach is discussed. Exam testing is distinguished from continuous monitoring, a necessary function that well-constructed computer assisted language instruction may perform well. It is argued that computer tests also teach, and can handle much of the remedial instruction otherwise…

Reports a study of the administration mode, scores, and testing experiences of students taking the PreProfessional Skills Test (PPST) under differing conditions (computer based and paper and pencil). PPST scores and surveys of the students revealed varied test-taking strategies and computer-related alterations in test difficulty, construct,…

Six medical school faculty evaluated the overall performance of eight students completing a surgery clerkship at the Michigan State University College of Human Medicine. Students were also evaluated by the National Board of Medical Examiners' Computer Based Examination (CBX). Faculty ratings correlated highly with scores produced by the CBX's…