arrow
返回

Multi-agent Continuous Control with Generative Flow Networks

delete2024-06-01
delete0
delete
OA
AI
S
Shuang Luo
Y
Yinchuan Li *
S
Shunyu Liu
X
Xu Zhang
Y
Yunfeng Shao
吴
吴超 (Chao Wu) *
DOI:10.1016/j.neunet.2024.106243delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Generative Flow Networks (GFlowNets) aim to generate diverse trajectories from a distribution in which the final states of the trajectories are proportional to the reward, serving as a powerful alternative to reinforcement learning for exploratory control tasks. However, the individual -flow matching constraint in GFlowNets limits their applications for multi -agent systems, especially continuous joint -control problems. In this paper, we propose a novel Multi -Agent generative Continuous Flow Networks (MACFN) method to enable multiple agents to perform cooperative exploration for various compositional continuous objects. Technically, MACFN trains decentralized individual -flow -based policies in a centralized global -flow -based matching fashion. During centralized training, MACFN introduces a continuous flow decomposition network to deduce the flow contributions of each agent in the presence of only global rewards. Then agents can deliver actions solely based on their assigned local flow in a decentralized way, forming a joint policy distribution proportional to the rewards. To guarantee the expressiveness of continuous flow decomposition, we theoretically derive a consistency condition on the decomposition network. Experimental results demonstrate that the proposed method yields results superior to the state-of-the-art counterparts and better exploration capability. Our code is available at https://github.com/isluoshuang/MACFN.
Keyword:
Continuous Control
Generative Flow Networks
Multi-agent System
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

A Multi-Agent Framework for Packet Routing in Wireless Sensor Networks
errSENSORS
IF3.5
err2015-04-28
err76
errOAAI
errYe, Dayon; Zhang, Minji; Yang, Yu
err分享
err收藏
err分享
err收藏
Priming
err2002-01-01
err0
PREAI
errAnthony D. Wagner; Wilma Koutstaal
err分享
err收藏
err分享
err收藏
Strategic Densification With UAV-BSs in Cellular Networks
err2018-06-01
err0
PREAI
errFaraj Lagum; Irem Bor-Yaliniz; Halim Yanikomeroglu
err分享
err收藏
Resource Allocation and Service Provisioning in Multi-Agent Cloud Robotics: A Comprehensive Survey
err2021-01-01
err79
errOAAI
errAfrin, Mahbuba; Jin, Jiong; Rahman, Akhlaqur; Rahman, Ashfaqur; Wan, Jiafu; Hossain, Ekram
err分享
err收藏
学者 查看更多内容