NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1460544
Record Type: Journal
Publication Date: 2025
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: 2024-07-17
Evaluating the Quality of Student-Generated Content in Learnersourcing: A Large Language Model Based Approach
Kangkang Li1,2; Chengyang Qian1; Xianmin Yang1,2
Education and Information Technologies, v30 n2 p2331-2360 2025
In learnersourcing, automatic evaluation of student-generated content (SGC) is significant as it streamlines the evaluation process, provides timely feedback, and enhances the objectivity of grading, ultimately supporting more effective and efficient learning outcomes. However, the methods of aggregating students' evaluations of SGC face the problems of inefficiency and cold start. The methods of combining feature engineering and deep learning suffer from the problems of insufficient accuracy and low scalability. This study introduced an automated SGC quality evaluation method based on a large language model (LLM). The method made a comprehensive evaluation by allowing LLM to simulate the cognitive process of human evaluation through the Reason-Act-Evaluate (RAE) prompt and integrating an assisted model to analyze the external features of SGCs. The study utilized the SGCs in a learnersourcing platform to experiment with the feasibility of the method. The results showed that LLM is able to achieve high agreement with experts on the quality evaluation of SGC through RAE prompt, and better results can be achieved with the help of assisted models.
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Jiangsu Normal University, Department of Educational Technology, School of Smart Education, Xuzhou, China; 2Jiangsu Normal University, Jiangsu Engineering Research Center of Educational Informatization, Xuzhou, China