Possible future practices in testing are discussed, with a critique of current educational measurement. As standardized achievement tests are used for wide-ranging purposes, there will be increasing reliance on item response theory and national item banks. A national system of monitoring development and use of tests will probably emerge. (SLD)

This paper presents ongoing research at the University of Hertfordshire on the use of computer-adaptive tests (CATs) in Higher Education. A software prototype based on Item Response Theory has been developed and is described here. This application was designed to estimate the level of proficiency in English for those students whose first language…

Automated Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written prose (Shermis & Barrera, 2002; Shermis & Burstein, 2003; Shermis, Raymat, & Barrera, 2003). AES systems are mainly used to overcome time, cost, reliability, and generalizability issues in writing assessment (Bereiter, 2003; Burstein,…

Introduction: For postgraduate training of doctors there is a need for valid and reliable instruments to assess their daily performance. Various instruments have been suggested, some of which use incognito simulated patients (SPs). These methods are resource intensive. Computerised Case-based testing (CCT) is logistically simpler and may still…

The goals of our study were to determine the predictive value and usability of an audience response system (ARS) as a knowledge assessment tool in an undergraduate medical curriculum. Over a three year period (2006-2008), data were collected from first year didactic blocks in Genetics/Histology and Anatomy/Radiology (n = 42-50 per class). During…

Due to the anonymous nature of online courses, many instructors require some type of proctored, comprehensive exam at the conclusion of the course. While comprehensive final exams are not unique to the online classroom, the integration of a proctored, high-stakes assessment helps to ensure that the student registered for a course is actually the…

The purpose of this study was to use a nonexperimental, quantitative design to compare mail and web surveys with survey mode self-selection at two data collection waves. Research questions examined differences and predictabilities among demographics (gender, ethnicity, age, and professional employment) and response quality (pronoun use, item…

To evaluate the value of computer-administered interviews and rating scales, the following topics are reviewed in the present article: (a) strengths and weaknesses of structured and unstructured assessment instruments, (b) advantages and disadvantages of computer administration, and (c) the validity and utility of computer-administered interviews…

TRAILS (Tool for Real-Time Assessment of Information Literacy Skills), is a free online test of student information-handling skills. It was formulated by the Institute for Library and Information Literacy Education and Kent State University Libraries. Based on the Ohio Academic Content Standards and the philosophy of Information Power, it assesses…

The in house development of an online assessment tool, OASIS, has provided a unique opportunity to research the use of online assessment in teaching and learning across the university. The developing relationship between IT staff, educational designers and academics serves as a model for integrated and evolving management systems which demonstrate…

The objectives of this study were to (1) evaluate group differences in specific arithmetic competencies among students with various types of learning difficulties (LD) and (2) to examine the influence of attention behaviors on possible group differences. Participants were a community sample of 291 third- and fourth-grade students with reading…

This paper describes the development of an adaptive assessment called Interactive Computerised Assessment System (InCAS) that is aimed at children of a wide age and ability range to identify specific reading problems. Rasch measurement has been used to create the equal interval scales that form each part of the assessment. The rationale for the…

The mission of the National Academy for Integration of Research, Teaching and Learning (NAIRTL) is to ensure that all higher education students are exposed to cutting edge research in their classrooms, and that students at undergraduate and postgraduate levels are actively engaged in relevant and authentic research in their chosen discipline. To…

This article uses the notion of professional identity within the framework of actor network theory to understand didactic practices within three faculties in an institution of higher education. The study is based on a series of interviews with lecturers in each faculty and diaries of their didactic practices. The article focuses on the use of a…

This technical report documents the procedures followed in developing student and teacher surveys to gather information about the accommodations students are accustomed to receiving and those that might be beneficial on a mathematics test delivered on the computer. It provides documentation of the technical adequacy of the survey instruments, as…