arrow
返回

Structural relational inference actor-critic for multi-agent reinforcement learning

delete2021-10-01
delete16
delete
OA
AI
X
Xianjie Zhang
刘
刘昱 (Yu Liu) *
X
Xiujuan Xu
Q
Qiong Huang
H
Hangyu Mao
A
Anil Carie
DOI:10.1016/j.neucom.2021.07.014delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Multi-agent reinforcement learning (MARL) is essential for a wide range of high-dimensional scenarios and complicated tasks with multiple agents. Many attempts have been made for agents with prior domain knowledge and predefined structure. However, the interaction relationship between agents in a multi-agent system (MAS) in general is usually unknown, and previous methods could not tackle dynamical activities in an ever-changing environment. Here we propose a multi-agent Actor-Critic algo-rithm called Structural Relational Inference Actor-Critic (SRI-AC), which is based on the framework of centralized training and decentralized execution. SRI-AC utilizes the latent codes in variational autoen-coder (VAE) to represent interactions between paired agents, and the reconstruction error is based on Graph Neural Network (GNN). With this framework, we test whether the reinforcement learning learners could form an interpretable structure while achieving better performance in both cooperative and com-petitive scenarios. The results indicate that SRI-AC could be applied to complex dynamic environments to find an interpretable structure while obtaining better performance compared to baseline algorithms. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Multi-agent systems
Deep reinforcement learning
Variational autoencoder
Actor-critic
Graph neural network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
V
vit-ap university
学者数:
1.0K
论文数: 909
被引数: 5
D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
学者 查看更多机构
引用论文

引用论文

Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
A Multi-Agent Framework for Packet Routing in Wireless Sensor Networks
errSENSORS
IF3.5
err2015-04-28
err76
errOAAI
errYe, Dayon; Zhang, Minji; Yang, Yu
err分享
err收藏
Nonsyndromic Cleft Lip With or Without Cleft Palate in China: Assessment of Candidate Regions
err2002-03-01
err0
PREAI
errMary L. Marazita; L. Leigh Field; Margaret E. Cooper; Rose Tobias; Brion S. Maher; Supakit Peanchitlertkajorn; You-e Liu
err分享
err收藏
Fabrication and Evaluation of Flexible Micro‐Supercapacitor from MWCNTs‐Ag Nanohybrid‐Sulfonated PANI Nanocomposite Embedded PVA‐TEOS Membrane
err2021-04-01
err0
PREAI
errSatishkumar R. Naik; Anand I. Torvi; Balappa B. Munavalli; Divya D. Achari; Mahadevappa Y. Kariduraganavar
err分享
err收藏
Priming
err2002-01-01
err0
PREAI
errAnthony D. Wagner; Wilma Koutstaal
err分享
err收藏
Risk of second primary papillary thyroid cancer among adult cancer survivors in the United States, 2000-2015
err2020-02-01
err0
errOAAI
errSara J. Schonfeld; Lindsay M. Morton; Amy Berrington de González; Rochelle E. Curtis; Cari M. Kitahara
err分享
err收藏
err分享
err收藏
Principal Families of Cheese
err2016-08-23
err0
PREAI
errPatrick F. Fox; Timothy P. Guinee; Timothy M. Cogan; Paul L. H. McSweeney
err分享
err收藏
学者 查看更多内容