.png){kind=icon}
返回
Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array
.png){kind=icon}
OA
AI
DOI：10.1038/s41467-024-53654-y.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Capturing forceful interaction with deformable objects during manipulation benefits applications like virtual reality, telemedicine, and robotics. Replicating full hand-object states with complete geometry is challenging because of the occluded object deformations. Here, we report a visual-tactile recording and tracking system for manipulation featuring a stretchable tactile glove with 1152 force-sensing channels and a visual-tactile joint learning framework to estimate dynamic hand-object states during manipulation. To overcome the strain interference caused by contact with deformable objects, an active suppression method based on symmetric response detection and adaptive calibration is proposed and achieves 97.6% accuracy in force measurement, contributing to an improvement of 45.3%. The learning framework processes the visual-tactile sequence and reconstructs hand-object states. We experiment on 24 objects from 6 categories including both deformable and rigid ones with an average reconstruction error of 1.8 cm for all sequences, demonstrating a universal ability to replicate human knowledge in manipulating objects with varying degrees of deformability. The authors report a stretchable tactile array with strain insensitivity, and a visual-tactile joint learning framework, achieving high-accuracy force measurement and replicating full states of hand and manipulated objects with fine-grained geometry.
Keyword:
SENSOR
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
15.7
论文数:
9.4W
被引数:
91.2W
机构
引用论文
分享收藏Robots for the people, by the people: Personalizing human-machine interaction.png)
SCIENCE ROBOTICS
SCIENCE ROBOTICSIF27.5
PREAI
分享收藏All-printed soft human-machine interface for robotic physicochemical sensing用于机器人物理化学传感的全打印软人机界面SCIENCE ROBOTICS
OAAI
SCIENCE ROBOTICSIF27.5
OAAI分享收藏3D-Printed Graphene/Polydimethylsiloxane Composites for Stretchable and Strain-Insensitive Temperature Sensors3d打印石墨烯/聚二甲基硅氧烷复合材料，用于可拉伸和应变不敏感的温度传感器
PREAI
分享收藏A stretchable and strain-unperturbed pressure sensor for motion interference-free tactile monitoring on skins一种可拉伸且无应变的压力传感器，用于皮肤上的无运动干扰触觉监测SCIENCE ADVANCESOAAI
SCIENCE ADVANCESIF12.5
OAAI分享收藏
查看更多内容