.png){kind=icon}
返回
Determining Exception Context in Assembly Operations from Multimodal Data
.png){kind=icon}
OA
AI
DOI：10.3390/s22207962.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Robot assembly tasks can fail due to unpredictable errors and can only continue with the manual intervention of a human operator. Recently, we proposed an exception strategy learning framework based on statistical learning and context determination, which can successfully resolve such situations. This paper deals with context determination from multimodal data, which is the key component of our framework. We propose a novel approach to generate unified low-dimensional context descriptions based on image and force-torque data. For this purpose, we combine a state-of-the-art neural network model for image segmentation and contact point estimation using force-torque measurements. An ensemble of decision trees is used to combine features from the two modalities. To validate the proposed approach, we have collected datasets of deliberately induced insertion failures both for the classic peg-in-hole insertion task and for an industrially relevant task of car starter assembly. We demonstrate that the proposed approach generates reliable low-dimensional descriptors, suitable as queries necessary in statistical learning.
Keyword:
sensor fusion
predictive clustering trees
autonomous exception handling
autonomous assembly
peg-in-hole
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
Robust Multi-Modal Sensor Fusion: An Adversarial Approach鲁棒多模态传感器融合: 一种对抗方法.png)
IEEE SENSORS JOURNALOAAI
IEEE SENSORS JOURNALIF4.5
OAAI分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor AirOAAI
Indoor AirIF0
OAAI分享收藏Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects多模态数据融合: 方法、挑战与展望综述PROCEEDINGS OF THE IEEEOAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAI分享收藏
查看更多内容