NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1185606
Record Type: Journal
Publication Date: 2018-Aug
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: N/A
Available Date: N/A
Enhancing Multimodal Learning through Personalized Gesture Recognition
Junokas, M. J.; Lindgren, R.; Kang, J.; Morphew, J. W.
Journal of Computer Assisted Learning, v34 n4 p350-357 Aug 2018
Gestural recognition systems are important tools for leveraging movement-based interactions in multimodal learning environments but personalizing these interactions has proven difficult. We offer an adaptable model that uses multimodal analytics, enabling students to define their physical interactions with computer-assisted learning environments. We argue that these interactions are foundational to developing stronger connections between students' physical actions and digital representations within a multimodal space. Our model uses real time learning analytics for gesture recognition, training a hierarchical hidden-Markov model with a "one-shot" construct, learning from user-defined gestures, and accessing 3 different modes of data: "skeleton positions," "kinematics features," and "internal model parameters." Through an empirical comparison with a "pretrained" model, we show that our model can achieve a higher recognition accuracy in repeatability and recall tasks. This suggests that our approach is a promising way to create productive experiences with gesture-based educational simulations, promoting personalized interfaces, and analytics of multimodal learning scenarios.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com.bibliotheek.ehb.be/WileyCDA
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: IIS1441563
Author Affiliations: N/A