arrow
返回

Robotic Material Perception Using Active Multimodal Fusion

delete2019-12-01
delete32
PRE
AI
刘华坪 封面图
刘华坪 (Huaping Liu) *
孙富春 封面图
孙富春 (Fuchun Sun)
X
Xinyu Zhang
DOI:10.1109/TIE.2018.2878157delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Robotic material perception is an extremely important but challenging problem for industrial intelligence. The main difficulties come from the fact that the material properties are difficult to be comprehensibly evaluated by single visual, auditory, or tactile modality. Conventional multimodal fusion methods require collecting all of the multimodal information for a testing sample before the recognition. This is expensive, redundant, and may incur large latency. To tackle this problem, a new active fusion framework for the multimodal material recognition is proposed in this paper. We first adopt the adversarial learning method to obtain the modal-invariant representations to effectively bridge the gap between different modalities and then develop a reinforcement learning method for active modality selection. The developed framework and algorithms are evaluated on a publicly available dataset and show promising material recognition results. The developed framework provides an effective method for industrial material inspection.
Keyword:
Active perception
adversarial learning
material recognition
multimodal fusion
reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Industrial Electronics 封面图
IEEE Transactions on Industrial Electronics
IF:
7.2
论文数:
1.8W
被引数:
9.8W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Displacement sensor using channelled spectrum dispersed on a linear CCD array
err1993-05-13
err0
PREAI
errS. Taplin; A.Gh. Podoleanu; D.J. Webb; D.A. Jackson
err分享
err收藏
Study on Electroosmosis Consolidation of Punctiform Electrode Unit
err2021-04-12
err0
errOAAI
errXiaoyu Yang; Yongbin Xie; Jianhua Dong; Guosheng Liu; Yalin Zheng
err分享
err收藏
Multi-spectral saliency detection
err2013-01-01
err108
PREAI
errWang, Qi; Yan, Pingkun; Yuan, Yuan; Li, Xuelong
err分享
err收藏
Acetolysis of trans-1,2-dibromobenzocyclobutene
err1964-01-01
err0
PREAI
errH. Nozaki; R. Noyori; N. Kôzaki
err分享
err收藏
Photoperiodic Effects on Steroid Negative Feedback in Female Prairie Voles (Microtus ochrogaster)
err1995-10-01
err0
errOAAI
errChristopher A. Moffatt; Jonathan M. Gerber; Joan M.C. Blom; Lance J. Kriegsfeld; Randy J. Nelson
err分享
err收藏
Multi-cue based tracking
err2014-05-01
err89
PREAI
errWang, Qi; Fang, Jianwu; Yuan, Yuan
err分享
err收藏
学者 查看更多内容