返回
Morphing aircraft acceleration and deceleration task morphing strategy using a reinforcement learning method
DOI:10.1007/s10489-023-04876-y.png)
摘要
En 中文
This paper proposes a design scheme for a whole morphing strategy based on the reinforcement learning (RL) method. A novel morphing aircraft is designed, and its nonlinear dynamic equations are established based on the calculated aerodynamic data. Further, a soft actor critic (SAC) approach is utilized to design the scheme, whose structure consists of the environment, the agent, and the reward function. In the environment design part, the incremental backstepping approach is employed to design the morphing aircraft controller. The safety and feasibility of deployment are verified. In the agent design part, in addition to using the entropy regularization RL algorithm, the generalization ability of the agent is enhanced in three ways: adding environmental noise, adding control command randomness, and adding output momentum terms. For the reward function, a structure with dynamic and steady-state performance is designed to accurately describe the aircraft dynamics. Finally, the designed SAC strategy is verified under the acceleration and deceleration tasks and compared with a GA and PPO strategy. Simulation results validate the effectiveness and superiority of the designed SAC scheme.
Keyword:
Morphing aircraft
Morphing strategy
Incremental backstepping
Reinforcement learning
Generalization ability
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Attitude control for hypersonic reentry vehicles: An efficient deep reinforcement learning method高超声速再入飞行器姿态控制: 一种有效的深度强化学习方法
Event-triggered reinforcement learning control for the quadrotor UAV with actuator saturation执行器饱和的四旋翼无人机事件触发强化学习控制
NEUROCOMPUTING
IF6.5
Homeostatic Regulation of the Duox-ROS Defense System: Revelations Based on the Diversity of Gut Bacteria in Silkworms (Bombyx mori)家蚕Duox-ROS防御系统的稳态调控:基于肠道细菌多样性的新发现 (Bombyx mori)
Integrated Morphing Strategy and Trajectory Optimization of a Morphing Waverider and Its Online Implementation Based on the Neural Network基于神经网络的变形小波综合策略与轨迹优化及其在线实现
IEEE ACCESS
IF3.6
Reproductive biology and floral visitors of Collaea cipoensis (Fabaceae), an endemic shrub of the rupestrian grasslands
Flora
IF0

