arrow
返回

Versatile Control of Fluid-directed Solid Objects Using Multi-task Reinforcement Learning

delete2022-10-18
delete1
PRE
AI
B
Bo Ren *
X
Xiaohan Ye
Z
Zherong Pan
T
Taiyuan Zhang
DOI:10.1145/3554731delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a learning-based controller for high-dimensional dynamic systems with coupled fluid and solid objects. The dynamic behaviors of such systems can vary across different simulators and the control tasks subject to changing requirements from users. Our controller features high versatility and can adapt to changing dynamic behaviors and multiple tasks without re-training, which is achieved by combining two training strategies. We use meta-reinforcement learning to inform the controller of changing simulation parameters. We further design a novel task representation, which allows the controller to adapt to continually changing tasks via hindsight experience replay. We highlight the robustness and generality of our controller on a row of dynamic-rich tasks, including scooping up solid balls from a water pool, in-air ball acrobatics using fluid spouts, and zero-shot transferring to unseen simulators and constitutive models. In all the scenarios, our controller consistently outperforms the plain multi-task reinforcement-learning baseline.
Keyword:
Fluid/solid coupling
optimal control
reinforcement learning

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

N
nankai university
学者数:
4.8W
论文数: 3.3W
被引数: 74
引用论文

引用论文

Transport-Based Neural Style Transfer for Smoke Simulations
err2019-11-08
err32
errOAAI
errKim, Byungsoo; Azevedo, Vinicius C.; Gross, Markus; Solenthaler, Barbara
err分享
err收藏
Realistic Biomechanical Simulation and Control of Human Swimming
err2014-12-29
err57
PREAI
errSi, Weiguang; Lee, Sung-Hee; Sifakis, Eftychios; Terzopoulos, Demetri
err分享
err收藏
DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
err2018-07-30
err322
errOAAI
errPeng, Xue Bin; Abbeel, Pieter; Levine, Sergey; van de Panne, Michiel
err分享
err收藏
Fluid control using the adjoint method使用伴随方法进行流体控制
err2004-08-01
err235
PREAI
errMcNamara, A; Treuille, A; Popovic, Z; Stam, J
err分享
err收藏
Optimizing Locomotion Controllers Using Biologically-Based Actuators and Objectives
err2012-07-01
err139
errOAAI
errWang, Jack M.; Hamner, Samuel R.; Delp, Scott L.; Koltun, Vladlen
err分享
err收藏
Soft Body Locomotion
err2012-07-01
err40
PREAI
errTan, Jie; Turk, Greg; Liu, C. Karen
err分享
err收藏
学者 查看更多内容