ERIC Number: EJ1469585
Record Type: Journal
Publication Date: 2025-Dec
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2731-5525
Available Date: 2025-04-30
Comparing Lesson Plan-Driven and Ask-Me-Anything Chatbots: Teaching a UNIX Shell Course
Jose Berengueres1,2
Discover Education, v4 Article 93 2025
GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots--Harvard's CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot--through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[-6, + 23].
Descriptors: Lesson Plans, Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Computer Software, Discovery Learning, Scores, Tutors
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1KTH Royal Institute of Technology, Department of Computer Science, Stockholm, Sweden; 2UAE University, College of IT (Affiliation During Data Collection), Abu Dhabi, UAE