.png){kind=icon}
返回
SofaGym: An Open Platform for Reinforcement Learning Based on Soft Robot Simulations
.png){kind=icon}
OA
AI
DOI：10.1089/soro.2021.0123.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
OpenAI Gym is one of the standard interfaces used to train Reinforcement Learning (RL) Algorithms. The Simulation Open Framework Architecture (SOFA) is a physics-based engine that is used for soft robotics simulation and control based on real-time models of deformation. The aim of this article is to present SofaGym,* an open-source software to create OpenAI Gym interfaces, called environments, out of soft robot digital twins. The link between soft robotics and RL offers new challenges for both fields: representation of the soft robot in an RL context, complex interactions with the environment, use of specific mechanical tools to control soft robots, transfer of policies learned in simulation to the real world, etc. The article presents the large possible uses of SofaGym to tackle these challenges by using RL and planning algorithms. This publication contains neither new algorithms nor new models but proposes a new platform, open to the community, that offers non existing possibilities of coupling RL to physics-based simulation of soft robots. We present 11 environments, representing a wide variety of soft robots and applications; we highlight the challenges showcased by each environment. We propose methods of solving the task using traditional control, RL, and planning and point out research perspectives using the platform.
Keyword:
SOFA
Finite Element Method
Reinforcement Learning
imitation learning
Monte Carlo Tree Search
OpenAI Gym
期刊
IF:
6.1
论文数:
760
被引数:
6.3K
机构
引用论文
分享收藏Long term follow up of severely ill patients who underwent urgent cardiac transplantation..png)
BMJ
OAAI
BMJIF0
OAAI分享收藏Critical Evaluation and Thermodynamic Optimization of the Li2O-Al2O3 and Li2O-MgO-Al2O3 Systems
PREAI
分享收藏A facile synthesis of naturally occurring binaphthoquinones: efficient oxidative dimerization of 4-alkoxy-1-naphthols using silver(II) oxide–40% nitric acidTetrahedron
TetrahedronIF0
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏
查看更多内容