.png){kind=icon}
返回
Multi-agent actor-critic with time dynamical opponent model
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2022.10.045.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In multi-agent reinforcement learning, multiple agents learn simultaneously while interacting with a common environment and each other. Since the agents adapt their policies during learning, not only the behavior of a single agent becomes non-stationary, but also the environment as perceived by the agent. This renders it particularly challenging to perform policy improvement. In this paper, we propose to exploit the fact that the agents seek to improve their expected cumulative reward and introduce a novel Time Dynamical Opponent Model (TDOM) to encode the knowledge that the opponent policies tend to improve over time. We motivate TDOM theoretically by deriving a lower bound of the log objective of an individual agent and further propose Multi-Agent Actor-Critic with Time Dynamical Opponent Model (TDOM-AC). We evaluate the proposed TDOM-AC on a differential game and the Multi-agent Particle Environment. We show empirically that TDOM achieves superior opponent behavior prediction during test time. The proposed TDOM-AC methodology outperforms state-of-the-art Actor-Critic methods on the performed tasks in cooperative and especially in mixed cooperative-competitive environments. TDOM-AC results in a more stable training and a faster convergence. Our code is available at https:// github.com/Yuantian013/TDOM-AC.(c) 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Keyword:
Reinforcement learning
Multi -agent reinforcement learning
Multi -agent systems
Opponent modeling
Non-stationarity
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
分享收藏Blurring the picture in leaky gut research: how shortcomings of zonulin as a biomarker mislead the field of intestinal permeability.png)
GutOAAI
GutIF0
OAAI分享收藏Autonomous agents modelling other agents: A comprehensive survey and open problems自治代理对其他代理进行建模: 全面调查和开放问题OAAI
OAAI分享收藏Finnish guidelines for the treatment of community‐acquired pneumonia and pertussis in children芬兰儿童社区获得性肺炎和百日咳治疗指南OAAI
OAAI分享收藏
没有更多内容
没有更多内容