.png){kind=icon}
返回
Object Description Using Visual and Tactile Data
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3174874.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
With the development of vision and haptic sensor technologies, robots have become increasingly capable of perceiving their external environment. Although machine vision and haptics have surpassed humans in some aspects of perception, it is difficult for robots to describe objects from multiple viewpoints using a combination of visual and haptic modalities. In this study, we use convolutional neural networks to separately extract visual and haptic features and then fuse these two types of features. Then, multitask learning is combined with multilabel classification to form a multitask-multilabel classification method. The developed method is used to identify the color, shape, material attributes, and class of an object from the visual-haptic fused feature vector. To verify the effectiveness of the proposed object description method, experiments are conducted on the PHAC-2 dataset and the collected VHAC dataset. The experimental results show that the proposed method produces the most accurate object descriptions with the smallest number of parameters.
Keyword:
Haptic interfaces
Visualization
Task analysis
Feature extraction
Shape
Image color analysis
Mathematical models
Object description
machine vision
machine haptics
multimodal fusion
multitasking-multilabel
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Diamond Tools in Stone and Civil Engineering Industry - Cutting Principles, Wear and Applications
PREAI
分享收藏Approaching coherent homodyne performance with direct detection low-complexity advanced modulation formats采用直接检测实现低复杂度高级调制格式，逼近相干外差性能
PREAI
分享收藏Damage Detection and Level Classification of Roof Damage After Typhoon Faxai Based on Aerial Photo and Deep Learning基于航拍照片和深度学习的Faxai台风后顶板损伤检测与等级分类.png)
OAAI
IF0
OAAI分享收藏
查看更多内容