ERIC Number: EJ1457899
Record Type: Journal
Publication Date: 2025-Jan
Pages: 37
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: N/A
AI ChatBots' Solutions to Mathematical Problems in Interactive E-Textbooks: Affordances and Constraints from the Eyes of Students and Teachers
Education and Information Technologies, v30 n1 p509-545 2025
One of the aims of the present study was to reveal and compare the performance of ChatGPT versions (GPT-4o, GPT-4, and GPT-3.5), MathGPT, and Gemini in solving 390 mathematical problems in interactive mathematics e-textbooks across various dimensions. The other aim was to identify the affordances and constraints of ChatGPT through the instrumental approach. Both quantitative and qualitative approaches were used. The participants were 160 high school students and 80 mathematics teachers. Data were collected through the evaluation forms, view forms, and interviews with students and teachers based on ChatGPT's solutions to the mathematical problems. The findings showed that the success rates of GPT-4o and GPT-4 were close to each other, with a slightly higher success rate of GPT-4o. This was followed by MathGPT and GPT-3.5. Gemini has the lowest success rate among the AI chatbots. Depending on the complexity of the mathematical problems, a statistically significant difference between the number of correct and incorrect solutions was found in all ChatGPT versions but not in MathGPT and Gemini. Furthermore, teachers and students referred to explanatory and detailed aspects of the solutions, learning without a teacher, getting solutions directly and quickly, and learning support as affordances of ChatGPT. On the other hand, the participants also acknowledged the constraints of ChatGPT while being aware of its affordances. Based on students' and teachers' expressions in the view forms and interviews, the mean scores they provided in the evaluation forms, and ChatGPT's high performance in solving mathematical problems, it is suggested that ChatGPT could be a useful tool for students' individual mathematics learning process.
Descriptors: Artificial Intelligence, Computer Software, Synchronous Communication, Electronic Books, Textbooks, Mathematics Education, Problem Solving, High School Teachers, Mathematics Teachers, High School Students, Secondary School Mathematics, Affordances, Technology Uses in Education
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A