arrow
Return

Multi-Task Multi-Agent Reinforcement Learning via Skill Graphs

delete
delete0
PRE
AI
G
Guobin Zhu
周睿 cover
周睿 (Rui Zhou)
W
Wenkang Ji
H
Hongyin Zhang
王东麟 cover
王东麟 (Donglin Wang)
S
Shiyu Zhao
DOI:10.1109/LRA.2025.3588784delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-task multi-agent reinforcement learning (M T-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle complex problems, as they are unable to handle unrelated tasks and possess limited knowledge transfer capabilities. In this paper, we propose a hierarchical approach that efficiently addresses these challenges. The high-level module utilizes a skill graph, while the low-level module employs a standard MARL algorithm. Our approach offers two contributions. First, we consider the MT-MARL problem in the context of unrelated tasks, expanding the scope of MTRL. Second, the skill graph is used as the upper layer of the standard hierarchical approach, with training independent of the lower layer, effectively handling unrelated tasks and enhancing knowledge transfer capabilities. Extensive experiments are conducted to validate these advantages and demonstrate that the proposed method outperforms the latest hierarchical MAPPO algorithms. Videos and code are available at https://github.com/WindyLab/MT-MARL-SG
Keywords:
Multi-robot systems
multi-agent reinforcement learning
multi-task reinforcement learning

Journal

I
IEEE Robotics and Automation Letters
IF:
5.3
Papers:
2.0K
Citations:
3.9W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
W
westlake university
Scholars:
5.3K
Papers: 3.7K
Citations: 8
Cited Papers

Cited Papers

Swarm Robotics: Past, Present, and Future
err2021-07-01
err166
errOAAI
errDorigo, Marco; Theraulaz, Guy; Trianni, Vito
errShare
errSave
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
err2022-02-01
err1.3K
errOAAI
errJi, Shaoxiong; Pan, Shirui; Cambria, Erik; Marttinen, Pekka; Yu, Philip S.
errShare
errSave
Decentralized Multi-Agent Pursuit Using Deep Reinforcement Learning
err2021-07-01
err0
errOAAI
errCristino de Souza; Rhys Newbury; Akansel Cosgun; Pedro Castillo; Boris Vidolov; Dana Kuli
errShare
errSave
On Reinforcement Learning for Full-Length Game of StarCraft
err2019-07-17
err0
errOAAI
errZhen-Jia Pang; Ruo-Ze Liu; Zhou-Yu Meng; Yi Zhang; Yang Yu; Tong Lu
errShare
errSave
A Deep Hierarchical Approach to Lifelong Learning in Minecraft
err2017-02-12
err0
errOAAI
errChen Tessler; Shahar Givony; Tom Zahavy; Daniel Mankowitz; Shie Mannor
errShare
errSave
Grandmaster level in StarCraft II using multi-agent reinforcement learning
err2019-10-30
err0
PREAI
errOriol Vinyals; Igor Babuschkin; Wojciech M. Czarnecki; Michaël Mathieu; Andrew Dudzik; Junyoung Chung; David H. Choi; Richard Powell; Timo Ewalds; Petko Georgiev; Junhyuk Oh; Dan Horgan; Manuel Kroiss; Ivo Danihelka; Aja Huang; Laurent Sifre; Trevor Cai; John P. Agapiou; Max Jaderberg; Alexander S. Vezhnevets; Rémi Leblond; Tobias Pohlen; Valentin Dalibard; David Budden; Yury Sulsky; James Molloy; Tom L. Paine; Caglar Gulcehre; Ziyu Wang; Tobias Pfaff; Yuhuai Wu; Roman Ring; Dani Yogatama; Dario Wünsch; Katrina McKinney; Oliver Smith; Tom Schaul; Timothy Lillicrap; Koray Kavukcuoglu; Demis Hassabis; Chris Apps; David Silver
errShare
errSave
researcher View more