.png){kind=icon}
返回
Multimodal Material Classification Using Visual Attention
.png){kind=icon}
OA
AI
DOI：10.3390/s24237664.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The material of an object is an inherent property that can be perceived through various sensory modalities, yet the integration of multisensory information substantially improves the accuracy of these perceptions. For example, differentiating between a ceramic and a plastic cup with similar visual properties may be difficult when relying solely on visual cues. However, the integration of touch and audio feedback when interacting with these objects can significantly clarify these distinctions. Similarly, combining audio and touch exploration with visual guidance can optimize the sensory examination process. In this study, we introduce a multisensory approach for categorizing object materials by integrating visual, audio, and touch perceptions. The main contribution of this paper is the exploration of a computational model of visual attention that directs the sampling of touch and audio data. We conducted experiments using a subset of 63 household objects from a publicly available dataset, the ObjectFolder dataset. Our findings indicate that incorporating a visual attention model enhances the ability to generalize material classifications to new objects and achieves superior performance compared to a baseline approach, where data are gathered through random interactions with an object's surface.
Keyword:
material classification
neural objects
visual attention
multimodal sensing
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.3W
被引数:
20.9W
机构
引用论文
Evaluation of 3D interest point detection techniques via human-generated ground truth.png)
VISUAL COMPUTER
VISUAL COMPUTERIF2.9
PREAI
分享收藏Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系？
PREAI
分享收藏Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges人体传感器网络中的多传感器融合: 最新技术和研究挑战INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and ForceGelSight: 用于估计几何形状和力的高分辨率机器人触觉传感器SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏分享收藏
查看更多内容