ERIC Number: EJ1462627
Record Type: Journal
Publication Date: 2025
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1176-3647
EISSN: EISSN-1436-4522
Available Date: 0000-00-00
Automatic Classification of Chinese Programming MOOC Reviews Using Fine-Tuned BERTs and GPT-Augmented Data
Xieling Chen; Haoran Xie; Di Zou; Lingling Xu; Fu Lee Wang
Educational Technology & Society, v28 n1 p230-249 2025
In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we examined the distribution of topics in 13,660 reviews related to a Chinese programming MOOC and identified "instructional skills," "perceived course value," "instructor characteristics," and "perceived course difficulty" as primary concerns among learners. Second, we proposed a GPTaug-BERT model that integrates fine-tuned bidirectional encoder representations from Transformers (BERT) models with augmented data generated using generative pre-trained Transformers (GPT) and applied it to classify learners' concerned topics automatically. Results showed that compared with machine learning and other deep learning architectures, the GPTaug-BERT model improved the F1 scores of the MOOC review topic recognition task by 7%. Third, we compared the effectiveness of the GPTaug-BERT model with the BERT-Chinese model in distinguishing between topics, showing that the GPTaug-BERT model achieved better performance with an accuracy of above 67% across all categories even for "online programming tools," "feedback and problem-solving," and "course structure" that were largely misclassified by the BERT-Chinese model. Findings offer insights into the effectiveness of combining fine-tuned BERT models with GPT-augmented data for facilitating accurate topic identification from MOOC reviews.
Descriptors: Classification, MOOCs, Teaching Skills, Artificial Intelligence, Computer Software, Course Evaluation, Models, Student Attitudes, Scores, Comparative Analysis, Feedback (Response), Problem Solving, Accuracy, Evaluation Methods, Foreign Countries
International Forum of Educational Technology & Society. Available from: National Yunlin University of Science and Technology. No. 123, Section 3, Daxue Road, Douliu City, Yunlin County, Taiwan 64002. e-mail: journal.ets@gmail.com; Web site: https://www.j-ets.net/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A
Author Affiliations: N/A