.png){kind=icon}
返回
AMCIU: An Adaptive Multimodal Complementary Intent Understanding Method
.png){kind=icon}
PRE
AI
DOI：10.1080/10447318.2025.2530087.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
With the aging of society, assistive companion robots have become an important solution to address the daily needs of the elderly. However, the elderly may suffer from slow thinking and memory loss, which makes it difficult for robots to accurately capture executable intentions during human-robot interaction. To address this challenge, this paper proposes an Adaptive Multimodal Complementary Intent Understanding Approach (AMCIU). First, a self-attentive mechanism is utilized to extract multimodal features of gestures, speech and images. Second, knowledge graph is utilized for the first time to obtain complementary information between image and audio modalities. Finally, robust intent integration is achieved through a multimodal hybrid expert intent fusion technique. In comparison with multiple state-of-the-art multimodal learning methods, AMCIU shows significant performance improvement in the building block tower scenario, where the intention understanding accuracy reaches 96.11%. This paper provides a novel research idea for natural human-robot interaction.
Keyword:
Intent understanding
human-robot interaction
human-robot collaboration
期刊
I
IF:
4.9
论文数:
4.5K
被引数:
1.2W
机构
引用论文
.png){kind=icon}
分享收藏分享收藏
查看更多内容