arrow
返回

Correspondence-Free, Function-Based Sim-to-Real Learning for Deformable Surface Control

delete2026-01-01
delete0
PRE
AI
Y
Yingjun Tian
G
Guoxin Fang
R
Renbo Su
A
Aoran Lyu
N
Neelotpal Dutta
W
Weiming Wang
S
Simeon Gill
A
Andrew Weightman
C
Charlie C. L. Wang
DOI:10.1109/TRO.2025.3647769delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article presents a correspondence-free, function-based sim-to-real learning method for controlling deformable freeform surfaces. Unlike traditional sim-to-real transfer methods that strongly rely on marker points with full correspondences, our approach simultaneously learns a deformation function space and a confidence map—both parameterized by a neural network (NN)—to map simulated shapes to their real-world counterparts. As a result, the sim-to-real learning can be conducted by input from either a 3-D scanner as point clouds (without correspondences) or a motion capture system as marker points (tolerating missed markers). The resultant sim-to-real transfer can be seamlessly integrated into a NN-based computational pipeline for inverse kinematics and shape control. We demonstrate the versatility and adaptability of our method on two vision devices and across four pneumatically actuated soft robots: a deformable membrane, a robotic mannequin, and two soft manipulators.
Keyword:
Correspondence-free
deformation control
free-form surface
sim-to-real learning
soft robotics

期刊

IEEE Transactions on Robotics 封面图
IEEE Transactions on Robotics
IF:
10.5
论文数:
3.3K
被引数:
2.8W

机构

T
the chinese university of hong kong
学者数:
4.5K
论文数: 2.1K
被引数: 0
T
the university of manchester
学者数:
1.2K
论文数: 526
被引数: 0
引用论文

引用论文

Dynamic Model of a Multibending Soft Robot Arm Driven by Cables
err2014-10-01
err378
PREAI
errRenda, Federico; Giorelli, Michele; Calisti, Marcello; Cianchetti, Matteo; Laschi, Cecilia
err分享
err收藏
Untethered Stretchable Displays for Tactile Interaction
err2019-02-01
err11
PREAI
errPeele, Bryan; Li, Shuo; Larson, Chris; Cortell, Jason; Habtour, Ed; Shepherd, Robert
err分享
err收藏
err分享
err收藏
学者 查看更多内容