ERIC Number: EJ739243
Record Type: Journal
Publication Date: 2004
Pages: 15
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0360-1315
EISSN: N/A
Available Date: N/A
The Development and Evaluation of a Software Prototype for Computer-Adaptive Testing
Lilley, M.; Barker, T.; Britton, C.
Computers and Education, v43 n1-2 p109-123 Aug-Sep 2004
This paper presents ongoing research at the University of Hertfordshire on the use of computer-adaptive tests (CATs) in Higher Education. A software prototype based on Item Response Theory has been developed and is described here. This application was designed to estimate the level of proficiency in English for those students whose first language is not English. Academic staff and students evaluated the prototype introduced here and we summarise their attitude to the user interface and to pedagogical aspects of the prototype. We provide evidence that learners are not disadvantaged by the CAT approach, based on a comparison of performance between CAT and computer-based tests. A group of international students also took part in a focus group session after using the software. During this session, students discussed issues related to computer-adaptive tests, ranging from their perception that very easy tests are "meaningless" to their insights into the fairness of such computer-assisted assessments. In addition, this paper outlines how our current work will be developed further by implementing multimedia resources, developing more subjective tests and adding a stop condition associated with the calculation of standard error. Finally, the benefits and potential limitations of this method of assessment are also presented here.
Descriptors: Foreign Countries, Adaptive Testing, Computer Assisted Testing, Computer Software Evaluation, Higher Education, Item Response Theory, Language Proficiency, English (Second Language), Man Machine Systems, Error of Measurement, Computer Attitudes, Multimedia Materials
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A
Author Affiliations: N/A