arrow
返回

Deep learning–enabled versatile shape perception for soft robots via single-ended multimode fiber

delete2026-06-12
delete0
delete
OA
AI
Z
Zhaofan He
L
Lele Wang
H
Haidi Geng
Z
Zhengyang Lu
T
Tiantian He
H
Hongkun Zhong
H
Hailong Zhang
R
Runfeng Zhu
Q
Qingxiang Zhao
孟
孟元 (Yuan Meng)
D
Dan Li
P
Ping Yan
Q
Qiang Liu *
Q
Qirong Xiao *
DOI:10.1126/sciadv.aef6263delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
软体机器人向具身智能系统的演化从根本上依赖于精确的本体感知。然而,一种通用的解决方案来捕获多样化交互过程中的连续变形,尤其是在空间受限的介入场景中,仍然缺乏。在此,我们介绍一种基于单端多模光纤(MMF)的深度学习赋能的通用形状感知方法。通过利用光学的固有集成优势,我们极简的反射式架构物理上消除了对复杂解调单元和远程设备的依赖。此外,将混沌光学散斑场视为编码高维形状信息的数据流,可重构神经解码器将单个物理通道解析为适用于异构任务的通用感知模式:软体夹持器的离散状态确认(>99%准确率)、仿生灵巧手的连续形状跟踪(约5倍空间分辨率提升)以及软体手术机器人的直观三维形态重建(IoU>0.93)。总体而言,我们的工作建立了一个通过计算突破硬件适应性限制的通用框架,为软体机器人的数字孪生闭环控制奠定了坚实基础。

期刊

Science Advances 封面图
Science Advances
IF:
12.5
论文数:
2.1W
被引数:
18.1W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
引用论文

引用论文

Maximum diffusion reinforcement learning
err2024-05-02
err0
PREAI
errBerrueta, Thomas A.; Pinosky, Allison; Murphey, Todd D.
err分享
err收藏
Controlling light propagation in multimode fibers for imaging, spectroscopy, and beyond
err2023-06-30
err33
errOAAI
errCao, Hui; Cizmar, Tomas; Turtaev, Sergey; Tyc, Tomas; Rotter, Stefan
err分享
err收藏
High-Speed All-Fiber Micro-Imaging with Large Depth of Field大景深高速全光纤微成像技术
err2022-07-03
err16
PREAI
errWang, Lele; Yang, Yousi; Liu, Zhoutian; Tian, Jiading; Meng, Yuan; Qi, Tiancheng; He, Tiantian; Li, Dan; Yan, Ping; Gong, Mali; Liu, Qiang; Xiao, Qirong
err分享
err收藏
An achromatic metafiber for focusing and imaging across the entire telecommunication range
err2022-07-19
err110
errOAAI
errRen, Haoran; Jang, Jaehyuck; Li, Chenhao; Aigner, Andreas; Plidschun, Malte; Kim, Jisoo; Rho, Junsuk; Schmidt, Markus A.; Maier, Stefan A.
err分享
err收藏
Machine Learning Assisted Electronic/Ionic Skin Recognition of Thermal Stimuli and Mechanical Deformation for Soft Robots
err2024-06-12
err1
errOAAI
errShi, Xuewei; Lee, Alamusi; Yang, Bo; Ning, Huiming; Liu, Haowen; An, Kexu; Liao, Hansheng; Huang, Kaiyan; Wen, Jie; Luo, Xiaolin; Zhang, Lidan; Gu, Bin; Hu, Ning
err分享
err收藏
Learning to sense three-dimensional shape deformation of a single multimode fiber
err2022-07-25
err10
errOAAI
errWang, Xuechun; Wang, Yufei; Zhang, Ketao; Althoefer, Kaspar; Su, Lei
err分享
err收藏
Shape sensing endoscope fiber
errOPTICA
IF8.5
err2024-10-18
err1
errOAAI
errLamb, Erin S.; Shi, Zhou; Kremp, Tristan; Digiovanni, David J.; Westbrook, Paul S.
err分享
err收藏
Embodied intelligence via learning and evolution通过学习和进化实现的智能
err2021-10-06
err48
errOAAI
errGupta, Agrim; Savarese, Silvio; Ganguli, Surya; Li Fei-Fei
err分享
err收藏
Silk-enabled conformal intraventricular interfaces for minimally invasive neural recordings丝素蛋白赋能的共形心室内接口用于微创神经记录
err2025-10-23
err0
errOAAI
errJizhi Liang; Xiner Wang; Zhaohan Chen; Xiaoling Wei; Liuyang Sun; Keyin Liu; Zhifeng Shi; Tiger H. Tao; Zhitao Zhou
err分享
err收藏
学者 查看更多内容