.png){kind=icon}
返回
Mobile Augmented Reality Based on Multimodal Inputs for Experiential Learning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3193498.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The power of mobile devices has been harnessed as a platform for augmented reality (AR) that has embarked on opportunities to combine more inputs called multimodal inputs. There has been little research into the multimodal inputs that combine emotion, speech and markers in a mobile AR learning environment. This study aims to propose a framework for a mobile AR learning system that incorporates the combination of multimodal inputs, namely emotion, image-based marker and speech in order to determine how such a combination can enhance the learning experience. The proposed framework integrates the multimodal inputs based on the decision tree and develops into a four-phase learning system based on Kolb's experiential learning model. To evaluate this learning system, 38 students were selected and divided into two groups for an experiment on vocabulary at a primary school. Quantitative findings showed better results concerning learning effectiveness, mental load, engagement, competency and challenge when the three multimodal inputs, speech, marker and emotion, were combined. Therefore, the proposed multimodal framework can be used as a guideline to develop a multimodal based AR application for learning environment by integrating multimodal inputs and Kolb's experiential learning model.
Keyword:
Vocabulary
Speech recognition
Augmented reality
Emotion recognition
Mobile handsets
Learning systems
Face detection
Augmented reality
decision tree
experiential learning
multimodal inputs
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Integrating augmented reality into problem based learning: The effects on learning achievement and attitude in physics education.png)
COMPUTERS & EDUCATION
COMPUTERS & EDUCATIONIF10.5
PREAI
分享收藏Defect states in LiFeAs as seen by low‐temperature scanning tunneling microscopy and spectroscopy
OAAI
OAAI分享收藏Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning挑战性游戏帮助学生学习: 基于游戏的学习中参与度，流程和沉浸感的实证研究OAAI
OAAI分享收藏分享收藏
查看更多内容