.png){kind=icon}
Return
Continuous self-adaptive optimization to learn multi-task multi-agent
.png){kind=icon}
OA
AI
DOI：10.1007/s40747-021-00591-8.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multi-agent reinforcement learning (MARL) methods have shown superior performance to solve a variety of real-world problems focusing on learning distinct policies for individual tasks. These approaches face problems when applied to the non-stationary real-world: agents trained in specialized tasks cannot achieve satisfied generalization performance across multiple tasks; agents have to learn and store specialized policies for individual task and reliable identities of tasks are hardly observable in practice. To address the challenge continuously adapting to multiple tasks in MARL, we formalize the problem into a two-stage curriculum. Single-task policies are learned with MARL approaches, after that we develop a gradient-based Self-Adaptive Meta-Learning algorithm, SAML, that cannot only distill single-task policies into a unified policy but also can facilitate the unified policy to continuously adapt to new incoming tasks. In addition, to validate the continuous adaptation performance on complex task, we extend the widely adopted StarCraft benchmark SMAC and develop a new multi-task multi-agent StarCraft environment, Meta-SMAC, for testing various aspects of continuous adaptation method. Our experiments with a population of agents show that our method enables significantly more efficient adaptation than reactive baselines across different scenarios.
Keywords:
Multi-task
Multi-agent
Meta-learning
Reinforcement learning
Self-adaptive optimization
Journal
IF:
4.6
Papers:
2.1K
Citations:
6.6K
Organization
Cited Papers
ShareSaveShareSaveShareSaveSolving two-stage stochastic route-planning problem in milliseconds via end-to-end deep learning
OAAI
OAAIShareSaveThe Alkaloid Compound Harmane Increases the Lifespan of Caenorhabditis elegans during Bacterial Infection, by Modulating the Nematode’s Innate Immune Response.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAIShareSaveShareSave
View more