.png){kind=icon}
返回
Learning Modular Robot Control Policies
.png){kind=icon}
OA
AI
DOI：10.1109/TRO.2023.3284362.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires its own unique control policy. One could craft a policy from scratch for each new design, but such an approach is not scalable, especially given the large number of designs that can be generated from even a small set of modules. Instead, we create a modular policy framework where the policy structure is conditioned on the hardware arrangement, and use just one training process to create a policy that controls a wide variety of designs. Our approach leverages the fact that the kinematics of a modular robot can be represented as a design graph, with nodes as modules and edges as connections between them. Given a robot, its design graph is used to create a policy graph with the same structure, where each node contains a deep neural network, and modules of the same type share knowledge via shared parameters (e.g., all legs on a hexapod share the same network parameters). We developed a model-based reinforcement learning algorithm, interleaving model learning and trajectory optimization to train the policy. We show the modular policy generalizes to a large number of designs that were not seen during training without any additional learning. Finally, we demonstrate the policy controlling a variety of designs to locomote with both simulated and real robots.
Keyword:
Cellular and modular robots
deep learning in robotics and automation
legged robots
model learning for control
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
引用论文
.png){kind=icon}
Improved Velocity Estimation Method for Doppler Sonar Based on Accuracy Evaluation and Selection
OAAI
OAAI分享收藏分享收藏Modular self-reconfigurable robot systems - Challenges and opportunities for the future模块化自重构机器人系统 -- 未来的挑战与机遇OAAI
OAAI分享收藏
查看更多内容