.png){kind=icon}
返回
Research on heterogeneous multi-UAV collaborative decision-making method based on improved PPO
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-024-05674-w.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In order to solve the problem that the Proximal Policy Optimization (PPO) algorithm is difficult to converge in the air-sea battle scenarios with high dynamics, strong interference, and complex state space, the Ray-LAPPO algorithm based on Long Short-Term Memory (LSTM) and Attention mechanism is proposed in this paper under the distributed training framework Ray. Firstly, the idea of Centralized Training Distributed Execution (CTDE) is adopted to extend the PPO algorithm to the field of multi-agent and the policy entropy is added to the loss function to encourage the exploration of agents; Secondly, the LSTM network is added to the actor and critic networks to explore the timing relationship between non-independent and identically distributed samples and improve the learning performance of the UAV; In addition, the Attention mechanism is introduced to obtain the states at different time steps and establish a weighted differentiation model of the final value function; Finally, the simulation experiments on the self-developed heterogeneous UAV collaborative decision-making environment show that Ray-LAPPO can get the most advanced performance in different scenarios, and also possesses potential value for large-scale real-world applications.
Keyword:
PPO algorithm
LSTM network
Attention mechanism
Multi-agent coordination
Deep reinforcement learning
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Integration of blockchain and federated learning for Internet of Things: Recent advances and future challenges区块链和物联网联合学习的集成: 最新进展和未来挑战.png)
COMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
分享收藏State representation modeling for deep reinforcement learning based recommendation基于深度强化学习推荐的状态表示建模
PREAI
分享收藏UAV navigation in high dynamic environments: A deep reinforcement learning approach高动态环境中的无人机导航: 一种深度强化学习方法
OAAI
OAAI分享收藏
查看更多内容