.png){kind=icon}
返回
Asynchronous parallel reinforcement learning for optimizing propulsive performance in fin ray control
.png){kind=icon}
OA
AI
DOI：10.1007/s00366-024-02093-w.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Fish fin rays constitute a sophisticated control system for ray-finned fish, facilitating versatile locomotion within complex fluid environments. Despite extensive research on the kinematics and hydrodynamics of fish locomotion, the intricate control strategies in fin-ray actuation remain largely unexplored. While deep reinforcement learning (DRL) has demonstrated potential in managing complex nonlinear dynamics; its trial-and-error nature limits its application to problems involving computationally demanding environmental interactions. This study introduces a cutting-edge off-policy DRL algorithm, interacting with a fluid-structure interaction (FSI) environment to acquire intricate fin-ray control strategies tailored for various propulsive performance objectives. To enhance training efficiency and enable scalable parallelism, an innovative asynchronous parallel training (APT) strategy is proposed, which fully decouples FSI environment interactions and policy/value network optimization. The results demonstrated the success of the proposed method in discovering optimal complex policies for fin-ray actuation control, resulting in a superior propulsive performance compared to the optimal sinusoidal actuation function identified through a parametric grid search. The merit and effectiveness of the APT approach are also showcased through comprehensive comparison with conventional DRL training strategies in numerical experiments of controlling nonlinear dynamics.
Keyword:
Off-policy RL
Dynamic control
Computational fluid dynamics
Fluid-structure interaction
期刊
IF:
4.9
论文数:
2.7K
被引数:
9.3K
机构
引用论文
Synthesis of new anti-bacterial agents: Hydrazide Schiff bases of vanadium acetylacetonate complexes
OAAI
OAAI分享收藏Applying deep reinforcement learning to active flow control in weakly turbulent conditions.png)
PHYSICS OF FLUIDSOAAI
PHYSICS OF FLUIDSIF4.3
OAAI分享收藏分享收藏Phase behavior for the poly(alkyl methacrylate)+supercritical CO2+DME mixture at high pressures
PREAI
分享收藏Plasma Hsp90 levels in patients with systemic sclerosis and relation to lung and skin involvement: a cross-sectional and longitudinal study系统性硬化症患者的血浆Hsp90水平及其与肺和皮肤受累的关系: 一项横断面和纵向研究SCIENTIFIC REPORTSOAAI
SCIENTIFIC REPORTSIF3.9
OAAI分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Vortex phase matching as a strategy for schooling in robots and in fishNATURE COMMUNICATIONSOAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏
查看更多内容