ERIC Number: EJ1463751
Record Type: Journal
Publication Date: 2025-Apr
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1059-0145
EISSN: EISSN-1573-1839
Available Date: 2025-01-15
Applying Machine Learning to Intelligent Assessment of Scientific Creativity Based on Scientific Knowledge Structure and Eye-Tracking Data
Yang Zhang1; Yangping Li1,2,3; Weiping Hu1; Huizhi Bai1; Yuanjing Lyu1
Journal of Science Education and Technology, v34 n2 p401-419 2025
Scientific creativity plays an essential role in science education as an advanced cognitive ability that inspires students to solve scientific problems inventively. The cultivation of scientific creativity relies heavily on effective assessment. Typically, human raters manually score scientific creativity using the Consensual Assessment Technique (CAT), which is a labor-intensive, time-consuming, and error-prone process. The assessment procedure is susceptible to subjective biases stemming from cognitive prejudice, distractions, fatigue, and fondness, potentially compromising its reliability, consistency, and efficiency. Previous research has sought to mitigate these risks by automating the assessment through latent semantic analysis and artificial intelligence. In this study, we developed machine learning (ML) models based on a training dataset that included output labels from the Scientific Creativity Test (SCT) evaluated by human experts, along with input features derived from objectively measurable semantic network parameters (representing the scientific knowledge structure) and eye-tracking blink duration (indicating attention patterns during the SCT). Most models achieve over 90% accuracy in predicting the scientific creativity levels of new individuals outside the training set, with some models achieving perfect accuracy. The results indicate that the ML models effectively capture the underlying relationship between scientific knowledge, eye movements, and scientific creativity. These models enable the fairly objective prediction of scientific creativity levels based on semantic network parameters and blink durations during the SCT, eliminating the need for ongoing human scoring. Therefore, laborious and complex manual assessment methods typically used for SCT can be avoided. This new method improves the efficiency of scientific creativity assessment by automating processes, minimizing subjectivity, providing rapid feedback, and enabling large-scale evaluations, all while reducing evaluators' workloads.
Descriptors: Eye Movements, Artificial Intelligence, Creativity, Scientific Concepts, Models, Science Education, Accuracy, Scientific and Technical Information, Scoring, Technology Uses in Education, Evaluation Methods
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Shaanxi Normal University, Key Laboratory of Modern Teaching Technology (Ministry of Education), Xi’an, P.R. China; 2Xi’an Jiaotong University, School of Foreign Studies, Xi’an, P.R. China; 3Provincial Key Laboratory of AI-Empowered Language & Culture Research, Xi’an, P.R. China