.png){kind=icon}
Return
Asynchronous parallel reinforcement learning for optimizing propulsive performance in fin ray control
.png){kind=icon}
OA
AI
DOI：10.1007/s00366-024-02093-w.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Fish fin rays constitute a sophisticated control system for ray-finned fish, facilitating versatile locomotion within complex fluid environments. Despite extensive research on the kinematics and hydrodynamics of fish locomotion, the intricate control strategies in fin-ray actuation remain largely unexplored. While deep reinforcement learning (DRL) has demonstrated potential in managing complex nonlinear dynamics; its trial-and-error nature limits its application to problems involving computationally demanding environmental interactions. This study introduces a cutting-edge off-policy DRL algorithm, interacting with a fluid-structure interaction (FSI) environment to acquire intricate fin-ray control strategies tailored for various propulsive performance objectives. To enhance training efficiency and enable scalable parallelism, an innovative asynchronous parallel training (APT) strategy is proposed, which fully decouples FSI environment interactions and policy/value network optimization. The results demonstrated the success of the proposed method in discovering optimal complex policies for fin-ray actuation control, resulting in a superior propulsive performance compared to the optimal sinusoidal actuation function identified through a parametric grid search. The merit and effectiveness of the APT approach are also showcased through comprehensive comparison with conventional DRL training strategies in numerical experiments of controlling nonlinear dynamics.
Keywords:
Off-policy RL
Dynamic control
Computational fluid dynamics
Fluid-structure interaction
Journal
IF:
4.9
Papers:
2.7K
Citations:
9.3K
Organization
Cited Papers
Synthesis of new anti-bacterial agents: Hydrazide Schiff bases of vanadium acetylacetonate complexes
OAAI
OAAIShareSaveApplying deep reinforcement learning to active flow control in weakly turbulent conditions.png)
PHYSICS OF FLUIDSOAAI
PHYSICS OF FLUIDSIF4.3
OAAIShareSaveShareSavePhase behavior for the poly(alkyl methacrylate)+supercritical CO2+DME mixture at high pressures
PREAI
ShareSavePlasma Hsp90 levels in patients with systemic sclerosis and relation to lung and skin involvement: a cross-sectional and longitudinal studySCIENTIFIC REPORTSOAAI
SCIENTIFIC REPORTSIF3.9
OAAIShareSaveShareSaveShareSaveVortex phase matching as a strategy for schooling in robots and in fishNATURE COMMUNICATIONSOAAI
NATURE COMMUNICATIONSIF15.7
OAAIShareSave
View more