arrow
返回

Multiagent Reinforcement Learning With Heterogeneous Graph Attention Network

delete2023-10-01
delete16
PRE
AI
W
Wei Du
S
Shifei Ding *
C
Chenglong Zhang
Z
Zhongzhi Shi
DOI:10.1109/TNNLS.2022.3215774delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most recent research on multiagent reinforcement learning (MARL) has explored how to deploy cooperative policies for homogeneous agents. However, realistic multiagent environments may contain heterogeneous agents that have different attributes or tasks. The heterogeneity of the agents and the diversity of relationships cause the learning of policy excessively tough. To tackle this difficulty, we present a novel method that employs a heterogeneous graph attention network to model the relationships between heterogeneous agents. The proposed method can generate an integrated feature representation for each agent by hierarchically aggregating latent feature information of neighbor agents, with the importance of the agent level and the relationship level being entirely considered. The method is agnostic to specific MARL methods and can be flexibly integrated with diverse value decomposition methods. We conduct experiments in predator-prey and StarCraft Multiagent Challenge (SMAC) environments, and the empirical results demonstrate that the performance of our method is superior to existing methods in several heterogeneous scenarios.
Keyword:
Reinforcement learning
Multi-agent systems
Aggregates
Task analysis
Scalability
Marine vehicles
Learning systems
Graph attention network
heterogeneous agents
multiagent reinforcement learning (MARL)
relationship-level attention

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Priming
err2002-01-01
err0
PREAI
errAnthony D. Wagner; Wilma Koutstaal
err分享
err收藏
没有更多内容