.png){kind=icon}
返回
Enhancing multimodal learning through personalized gesture recognition
.png){kind=icon}
PRE
AI
DOI：10.1111/jcal.12262.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Gestural recognition systems are important tools for leveraging movement-based interactions in multimodal learning environments but personalizing these interactions has proven difficult. We offer an adaptable model that uses multimodal analytics, enabling students to define their physical interactions with computer-assisted learning environments. We argue that these interactions are foundational to developing stronger connections between students' physical actions and digital representations within a multimodal space. Our model uses real time learning analytics for gesture recognition, training a hierarchical hidden-Markov model with a one-shot construct, learning from user-defined gestures, and accessing 3 different modes of data: skeleton positions, kinematics features, and internal model parameters. Through an empirical comparison with a pretrained model, we show that our model can achieve a higher recognition accuracy in repeatability and recall tasks. This suggests that our approach is a promising way to create productive experiences with gesture-based educational simulations, promoting personalized interfaces, and analytics of multimodal learning scenarios.
Keyword:
SIMULATION
SCIENCE
MOTION
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.6
论文数:
3.0K
被引数:
5.2K
机构
引用论文
.png){kind=icon}
分享收藏
Embodiment in Mathematics Teaching and Learning: Evidence From Learners' and Teachers' Gestures
PREAI
分享收藏
查看更多内容