NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1462560
Record Type: Journal
Publication Date: 2025-Mar
Pages: 31
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: 2024-08-28
Measuring Scientific Inquiry Ability Related to Hands-On Practice: An Automated Approach Based on Multimodal Data Analysis
Education and Information Technologies, v30 n4 p4381-4411 2025
Scientific inquiry ability is closely related to the process of hands-on inquiry practice. However, its assessment is often separated from this practice due to the limitation of technical basis and labor cost. The development of multimodal data analysis provides a new opportunity to realize automated assessment based on hands-on practice. Therefore, this study aims to explore whether and how we can use automated multimodal data analysis approaches to measure the scientific inquiry ability of students during the hands-on inquiry practice. In a scientific inquiry activity called "Explore the Moon," designed for 472 fourth graders, we collected textual, tabular, and video data. Aiming to analyze and evaluate the data, we first designed a modal conversion method based on the multimodal pre-trained model LLaVA-7B and a text scoring method integrating keyword matching, one-way nearness, and Jaccard similarity. Then, to bridge the computing ability with the scoring criteria from science teachers, we constructed a structured representation language and verified the human--machine consistency of automated scoring. Finally, we used a multidimensional item response theory (IRT) model to validate the assessment's overall quality and analyze the participants' scientific inquiry ability. The proposed data analysis method has high man--machine consistency, and the results of IRT analysis present reasonable item characteristics. In summary, we constructed a low-cost and scalable multimodal assessment approach based on scientific inquiry activities, providing methodological support for science teachers to carry out formative evaluation of students' scientific inquiry activities in the daily inquiry-based learning environment.
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link-springer-com.bibliotheek.ehb.be/
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Beijing Normal University, Research Center of Distance Education, Beijing, People’s Republic of China; 2Wenzhou University, Department of Educational Technology, Wenzhou, People’s Republic of China