arrow
返回

Robust multi-agent reinforcement learning via Bayesian distributional value estimation

delete2024-01-01
delete6
delete
OA
AI
X
Xinqi Du
陈贺昌 封面图
陈贺昌 (Hechang Chen) *
C
Che Wang
Y
Yongheng Xing
J
Jielong Yang
P
Philip S. Yu
Y
Yi Chang
L
Lifang He
DOI:10.1016/j.patcog.2023.109917delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Reinforcement learning in multi-agent scenarios is essential for real-world applications as it can vividly depict agents' collaborative and competitive behaviors from a perspective closer to reality. However, most existing studies suffer from poor robustness, preventing multi-agent reinforcement learning from practical applications where robustness is the core indicator of system security and stability. In view of this, we propose a novel Bayesian Multi-Agent Reinforcement Learning method, named BMARL, which leverages the distributional value function calculated by Bayesian inference to improve the robustness of the model. Specifically, Bayesian linear regression is adopted to estimate a posterior distribution concerning value function parameters, rather than approximating an expectation value for Q-value by point estimation. In this way, the value function is more generalized than previously obtained by point estimation, which is beneficial to the robustness of our model. Meanwhile, we utilize the Gaussian prior knowledge to integrate more prior knowledge while estimating the value function, which improves learning efficiency. Extensive experimental results on three benchmark multi -agent environments comparing with seven state-of-the-art methods demonstrate the superiority of BMARL in terms of both robustness and efficiency.
Keyword:
Multi-agent reinforcement learning
Bayesian inference
Distributional value function
Deep reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of illinois chicago hospital
学者数:
1.1W
论文数: 8.8K
被引数: 16
U
University of Illinois Chicago
学者数:
1.7W
论文数: 1.4W
被引数: 3.0W
University of Illinois System 封面图
University of Illinois System
学者数:
6.9W
论文数: 6.2W
被引数: 644
J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
学者 查看更多机构
引用论文

引用论文

An electrophoretic e‐paper device with stretchable, washable, and rewritable functions
err2022-04-29
err0
PREAI
errZhiguang Qiu; Simu Zhu; Hao Lu; Yifan Gu; Ziyi Wu; Gaofan Zhang; Shaozhi Deng; Bo‐Ru Yang
err分享
err收藏
Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
err分享
err收藏
Large-Scale Traffic Signal Control Using a Novel Multiagent Reinforcement Learning
err2021-01-01
err101
errOAAI
errWang, Xiaoqiang; Ke, Liangjun; Qiao, Zhimin; Chai, Xinghua
err分享
err收藏
Analysis on smart material suitable for autogenous microelectronic application
err2019-08-30
err0
PREAI
errR Sitharthan; Manimaran Ponnusamy; Madurakavi Karthikeyan; D Shanmuga Sundar
err分享
err收藏
err分享
err收藏
学者 查看更多内容