ERIC Number: EJ1459749
Record Type: Journal
Publication Date: 2024
Pages: 9
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0256-0100
EISSN: EISSN-2076-3433
Available Date: N/A
Is ChatGPT Reliable in Education?
South African Journal of Education, v44 n4 Article 2557 2024
After ChatGPT was released late in 2022, many arguments about its accuracy and use in education arose. In this article, I seek to provide evidence of the accuracy and validity of ChatGPT's responses to users' queries in education by applying a systematic review methodology to analyse publications in specific databases following PRISMA guidelines which provide a high level of evidence. Of 274 publications initially identified, 18 were included based on eligibility criteria. My findings show some limitations of ChatGPT, for example, a lack of deep understanding, limited ability to calculate problems, and difficulty with complex problems. Despite these limitations it was clear that ChatGPT was able to pass many exams and succeed in many assessment problems in a variety of education disciplines. Finally, based on the findings, I suggest an ABCD framework to successfully apply ChatGPT in education.
Descriptors: Artificial Intelligence, Technology Uses in Education, Reliability, Natural Language Processing, Accuracy, Validity, Computation, Program Evaluation
Education Association of South Africa. University of Pretoria, Centre for the Study of Resilience, Level 3, Groenkloof Student Centre, Department of Educational Psychology, Faculty of Education, George Storrar Road and Lleyds Street, Pretoria 0001, South Africa. Web site: http://www.sajournalofeducation.co.za/index.php/saje/index
Publication Type: Journal Articles; Information Analyses
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A