ERIC Number: EJ1427610
Record Type: Journal
Publication Date: 2024
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2229-0443
Available Date: N/A
A Comparative Study of AI-Human-Made and Human-Made Test Forms for a University TESOL Theory Course
Language Testing in Asia, v14 Article 19 2024
This study examines the efficacy of artificial intelligence (AI) in creating parallel test items compared to human-made ones. Two test forms were developed: one consisting of 20 existing human-made items and another with 20 new items generated with ChatGPT assistance. Expert reviews confirmed the content parallelism of the two test forms. Forty-three university students then completed the 40 test items presented randomly from both forms on a final test. Statistical analyses of student performance indicated comparability between the AI-human-made and human-made test forms. Despite limitations such as sample size and reliance on classical test theory (CTT), the findings suggest ChatGPT's potential to assist teachers in test item creation, reducing workload and saving time. These results highlight ChatGPT's value in educational assessment and emphasize the need for further research and development in this area.
Descriptors: Comparative Analysis, Artificial Intelligence, Computer Software, Test Items, Test Construction, Test Format, English (Second Language), Second Language Learning, Educational Assessment, Item Response Theory, Second Language Instruction
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A