arrow
返回

HyperComm: Hypergraph-based communication in multi-agent reinforcement learning

delete2024-10-01
delete1
PRE
AI
T
T. J. Zhu
X
Xinli Shi *
X
Xiangping Xu
J
Jie Gui
曹进德 (Jinde Cao)
DOI:10.1016/j.neunet.2024.106432delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the realm of fully cooperative multi -agent reinforcement learning (MARL), effective communication can induce implicit cooperation among agents and improve overall performance. In current communication strategies, agents are allowed to exchange local observations or latent embeddings, which can augment individual local policy inputs and mitigate uncertainty in local decision -making processes. Unfortunately, in previous communication schemes, agents may potentially receive irrelevant information, which increases training difficulty and leads to poor performance in complex settings. Furthermore, most existing works lack the consideration of the impact of small coalitions formed by agents in the multi -agent system. To address these challenges, we propose HyperComm , a novel framework that uses the hypergraph to model the multiagent system, improving the accuracy and specificity of communication among agents. Our approach brings the concept of hypergraph for the first time in multi -agent communication for MARL. Within this framework, each agent can communicate more effectively with other agents within the same hyperedge, leading to better cooperation in environments with multiple agents. Compared to those state-of-the-art communication -based approaches, HyperComm demonstrates remarkable performance in scenarios involving a large number of agents.
Keyword:
Multi-agent reinforcement learning (MARL)
Graph neural networks (GNNs)
Multi-agent communication
Centralized training with decentralized execution (CTDE)
execution (CTDE)
Multi-agent system

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
7.8K
被引数:
3.0W

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
引用论文

引用论文

Approximating Nash equilibrium for anti-UAV jamming Markov game using a novel event-triggered multi-agent reinforcement learning
err2023-04-01
err12
PREAI
errFeng, Zikai; Huang, Mengxing; Wu, Yuanyuan; Wu, Di; Cao, Jinde; Korovin, Iakov; Gorbachev, Sergey; Gorbacheva, Nadezhda
err分享
err收藏
err分享
err收藏
AMHGCN: Adaptive multi-level hypergraph convolution network for human motion prediction
err2024-04-01
err3
PREAI
errLi, Jinkai; Wang, Jinghua; Wu, Lian; Wang, Xin; Luo, Xiaoling; Xu, Yong
err分享
err收藏
Hypergraph convolution and hypergraph attention超图卷积与超图注意力
err2021-02-01
err333
errOAAI
errBai, Song; Zhang, Feihu; Torr, Philip H. S.
err分享
err收藏
PowerNet: Multi-Agent Deep Reinforcement Learning for Scalable Powergrid Control
err2022-03-01
err39
PREAI
errChen, Dong; Chen, Kaian; Li, Zhaojian; Chu, Tianshu; Yao, Rui; Qiu, Feng; Lin, Kaixiang
err分享
err收藏
学者 查看更多内容