arrow
返回

Efficient Multi-Agent Communication via Entity-Aware Causal Network

delete2026-01-09
delete0
PRE
AI
Y
Yifan Bo
B
Bowen Huang
J
Jinghan Feng
S
S. J. Zhang
B
Biao Leng
DOI:10.1016/j.neunet.2026.108538delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
通信被认为是解决复杂的多智能体强化学习(MARL)合作任务的关键方法。然而,现有方法依赖于预定义的智能体顺序和标识符来学习目标通信。预定义方法忽略了通信目标的选择仅与智能体的状态相关而非其顺序或标识符的先验知识,这导致可扩展性差和采样效率低下。为解决这些局限性,我们引入了实体感知因果(EAC)框架,该框架从实体中心视角解决MARL通信问题。其核心思想是通过实体感知的通信目标选择和因果推理信念机制来增强通信效率,我们做出了三方面的主要贡献。首先,我们设计了一个实体感知超网络,基于个体状态信息识别通信目标,并采用掩码注意力机制实现可扩展且稀疏的通信拓扑结构。其次,我们提出了一种因果推理信念机制,以强化实体间通信的信念并减少冗余消息交换。最后,我们的算法在SMAC、SMAC_v2、GRF和MPE基准测试中均优于基线多智能体合作强化学习算法。我们进一步展示了该算法在不同网络拓扑结构和稀疏性水平下的鲁棒性。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

B
beijing jiaotong university
学者数:
1.7K
论文数: 689
被引数: 0
B
beihang university
学者数:
5.2K
论文数: 2.0K
被引数: 21
引用论文

引用论文

Grandmaster level in StarCraft II using multi-agent reinforcement learning使用多智能体强化学习在星际争霸II中的大师水平
err2019-10-30
err0
PREAI
errOriol Vinyals; Igor Babuschkin; Wojciech M. Czarnecki; Michaël Mathieu; Andrew Dudzik; Junyoung Chung; David H. Choi; Richard Powell; Timo Ewalds; Petko Georgiev; Junhyuk Oh; Dan Horgan; Manuel Kroiss; Ivo Danihelka; Aja Huang; Laurent Sifre; Trevor Cai; John P. Agapiou; Max Jaderberg; Alexander S. Vezhnevets; Rémi Leblond; Tobias Pohlen; Valentin Dalibard; David Budden; Yury Sulsky; James Molloy; Tom L. Paine; Caglar Gulcehre; Ziyu Wang; Tobias Pfaff; Yuhuai Wu; Roman Ring; Dani Yogatama; Dario Wünsch; Katrina McKinney; Oliver Smith; Tom Schaul; Timothy Lillicrap; Koray Kavukcuoglu; Demis Hassabis; Chris Apps; David Silver
err分享
err收藏
GCS: Graph-Based Coordination Strategy for Multi-Agent Reinforcement Learning
err2022-05-09
err0
PREAI
errRuan,Jingqing; Du,Yali; Xiong,Xuantang; Xing,Dengpeng; Li,Xiyun; Meng,Linghui; Zhang,Haifeng; Wang,Jun; Xu,Bo
err分享
err收藏
err分享
err收藏
Hierarchical relationship modeling in multi-agent reinforcement learning for mixed cooperative-competitive environments
err2024-08-01
err2
PREAI
errXie, Shaorong; Li, Yang; Wang, Xinzhi; Zhang, Han; Zhang, Zhenyu; Luo, Xiangfeng; Yu, Hang
err分享
err收藏
Learning Correlated Communication Topology in Multi-Agent Reinforcement learning
err2021-05-03
err0
PREAI
errDu,Yali; Liu,Bo; Moens,Vincent; Liu,Ziqi; Ren,Zhicheng; Wang,Jun; Chen,Xu; Zhang,Haifeng
err分享
err收藏
学者 查看更多内容