.png){kind=icon}
返回
A Multimodal Human-Computer Interaction for Smart Learning System
.png){kind=icon}
PRE
AI
DOI：10.1080/10447318.2023.2206758.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The rise of digitalization and computing devices has transformed the educational landscape, making traditional teaching methods less productive. In this context, early and continuous user interaction is crucial for designing and developing effective learning applications. The field of Human-Computer Interaction (HCI) has seen significant technological growth, enabling educators to provide quality educational services through smart input and output channels. However, to prevent students from discontinuing their studies and help them grow their careers, a multimodal HCI approach is needed. This paper proposes a multimodal deep learning multi-layer Convolutional Neural Network (CNN) to improve the educational experience. Our designed system aims to create a promising solution for improving the educational experience and enabling educators to provide high-quality educational services to students. Our implementation results show promising real-time performances, including a high success rate in a constriction learning concept, a quality interaction experience, and enhanced educational services. We evaluated the accuracy of five multimodal inputs, including Finger Touch (FT), Hands Up (HU), Hands Down (HD), Voice Command (VC), and Click/Typing (CT). The results indicate an average accuracy of 90.8%, 87%, 88.6%, 91.8%, and 87%, respectively, demonstrating the effectiveness of our proposed approach.
Keyword:
Human-Computer Interaction
multimodal HCI
multilayer CNN
deep learning model
smart Learning System
期刊
I
IF:
4.9
论文数:
4.5K
被引数:
1.2W
机构
引用论文
Multimodal Approach of Speech Emotion Recognition Using Multi-Level Multi-Head Fusion Attention-Based Recurrent Neural Network.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏ZnO-based inverted organic solar cells: a comparative analysis of simulation and experimental devices基于ZnO的倒置有机太阳能电池：模拟器件与实验器件的比较分析
PREAI
分享收藏分享收藏Pride and guilt as mediators in the relationship between connection to nature and pro-environmental intention自豪感和内疚感作为自然联系与亲环境意向之间关系的媒介
OAAI
OAAI分享收藏
查看更多内容