.png){kind=icon}
返回
A fully value distributional deep reinforcement learning framework for multi-agent cooperation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2024.107035.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributional Reinforcement Learning (RL) extends beyond estimating the expected value of future returns by modeling its entire distribution, offering greater expressiveness and capturing deeper insights of the value function. To leverage this advantage, distributional multi-agent systems based on value-decomposition techniques were proposed recently. Ideally, a distributional multi-agent system should be fully distributional, which means both the individual and global value functions should be constructed in distributional forms. However, recent studies show that directly applying traditional value-decomposition techniques to this fully distributional form cannot guarantee the satisfaction of the necessary individual-global-max (IGM) principle. To address this problem, we propose a novel fully value distributional multi-agent framework based on value- decomposition and prove that the IGM principle can be guaranteed under our framework. Based on this framework, a practical deep reinforcement learning model called Fully Distributional Multi-Agent Cooperation (FDMAC) is proposed, and the effectiveness of FDMAC is verified under different scenarios of the StarCraft Multi-Agent Challenge micromanagement environment. Further experimental results show that our FDMAC model can outperform the best baseline by 10.47% on average in terms of the median test win rate.
Keyword:
Deep reinforcement learning
Multi-agent cooperation
Distributional reinforcement learning
Neural networks
期刊
IF:
6.3
论文数:
7.8K
被引数:
3.0W
机构
引用论文
IHG-MA: Inductive heterogeneous graph multi-agent reinforcement learning for multi-intersection traffic signal controlIhg-ma: 用于多路口交通信号控制的归纳异构图多智能体强化学习.png)
NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏Multi-agent reinforcement learning as a rehearsal for decentralized planning多智能体强化学习作为分散计划的演练NEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏分享收藏分享收藏Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic混合交通中高速公路匝道合并的深度多智能体强化学习
OAAI
OAAI分享收藏Q-learning based fault estimation and fault tolerant iterative learning control for MIMO systems基于Q学习的MIMO系统故障估计和容错迭代学习控制ISA TRANSACTIONSOAAI
ISA TRANSACTIONSIF6.5
OAAI分享收藏Human-level performance in 3D multiplayer games with population-based reinforcement learning基于人口的强化学习在3D多人游戏中的人类水平表现SCIENCEOAAI
SCIENCEIF45.8
OAAI分享收藏
查看更多内容