ERIC Number: EJ1467951
Record Type: Journal
Publication Date: 2025-Apr
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: 2024-11-04
Developing a Computer-Based Tutor Utilizing Generative Artificial Intelligence (GAI) and Retrieval-Augmented Generation (RAG)
Education and Information Technologies, v30 n6 p7841-7862 2025
This study investigates the development and evaluation of a Retrieval-Augmented Generation (RAG)-based statistics tutor designed to assist students with quantitative analysis methods. The RAG approach was employed to address the well-documented issue of hallucination in Large Language Models (LLMs). A computer tutor was developed that utilizes ChatGPT to understand student questions in natural language and retrieves relevant information from validated course notes to generate responses. The tutor was evaluated using twenty questions curated from the course notes. Two instructors who taught the course using the course notes assessed the quality of the tutor's response using a pre-defined rubric. The evaluation results indicate that the RAG-based tutor was able to provide correct and relevant answers to all twenty questions and to generate R code snippets upon request. This study highlights the potential of RAG-based tutors to provide accurate and personalized learning experiences for students while mitigating the risk of providing fabricated information often associated with LLMs.
Descriptors: Artificial Intelligence, Intelligent Tutoring Systems, Teachers, Students, Program Evaluation, Scoring Rubrics, Program Effectiveness, Accuracy, Individualized Instruction, Teacher Attitudes, Teaching Methods
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1College of Information, University of North Texas, Department of Learning Technologies, Denton, USA