arrow
返回

Multi-agent policy transfer via task relationship modeling

delete2024-07-22
delete0
PRE
AI
R
Rongjun Qin
陈
陈峰 (Feng Chen)
T
Tonghan Wang
L
Lei Yuan
章
章宗长 (Zongzhang Zhang)
C
Chongjie Zhang
Y
Yang Yu *
DOI:10.1007/s11432-023-3862-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous studies on multi-agent transfer learning have accommodated teams of different sizes but heavily relied on the generalization ability of neural networks for adapting to unseen tasks. We posit that the relationship among tasks provides key information for policy adaptation. We utilize this relationship for efficient transfer by attempting to discover and exploit the knowledge among tasks from different teams, proposing to learn an effect-based task representation as a common latent space among tasks, and using it to build an alternatively fixed training scheme. Herein, we demonstrate that task representation can capture the relationship among teams and generalize to unseen tasks. Thus, the proposed method helps transfer the learned cooperation knowledge to new tasks after training on a few source tasks. Furthermore, the learned transferred policies help solve tasks that are difficult to learn from scratch.
Keyword:
multi-agent reinforcement learning
cooperative transfer learning
task relationship modeling
multi-agent policy reuse
multi-agent multi-task learning

期刊

Science China Information Sciences 封面图
Science China Information Sciences
IF:
7.6
论文数:
4.9K
被引数:
8.9K

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Changes in muscle T2 and tissue damage after downhill running in mdx Mice
err2011-04-12
err0
errOAAI
errSunita Mathur; Ravneet S. Vohra; Sean A. Germain; Sean Forbes; Nathan D. Bryant; Krista Vandenborne; Glenn A. Walter
err分享
err收藏
Reinforcement learning to adjust parametrized motor primitives to new situations
err2012-04-05
err121
PREAI
errKober, Jens; Wilhelm, Andreas; Oztop, Erhan; Peters, Jan
err分享
err收藏
Localization of the t(2;13) breakpoint of alveolar rhabdomyosarcoma on a physical map of chromosome 2
err1992-08-01
err0
PREAI
errFrederic G. Barr; John Holick; Lynn Nycum; Jaclyn A. Biegel; Beverly S. Emanuel
err分享
err收藏
学者 查看更多内容