arrow
返回

Efficient and scalable reinforcement learning for large-scale network control

delete2024-09-03
delete0
delete
OA
AI
C
Chengdong Ma
A
Aming Li
Y
Yali Du
H
Hao Dong
Y
Yaodong Yang *
DOI:10.1038/s42256-024-00879-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The primary challenge in the development of large-scale artificial intelligence (AI) systems lies in achieving scalable decision-making-extending the AI models while maintaining sufficient performance. Existing research indicates that distributed AI can improve scalability by decomposing complex tasks and distributing them across collaborative nodes. However, previous technologies suffered from compromised real-world applicability and scalability due to the massive requirement of communication and sampled data. Here we develop a model-based decentralized policy optimization framework, which can be efficiently deployed in multi-agent systems. By leveraging local observation through the agent-level topological decoupling of global dynamics, we prove that this decentralized mechanism achieves accurate estimations of global information. Importantly, we further introduce model learning to reinforce the optimal policy for monotonic improvement with a limited amount of sampled data. Empirical results on diverse scenarios show the superior scalability of our approach, particularly in real-world systems with hundreds of agents, thereby paving the way for scaling up AI systems. Applying large-scale AI systems to multi-agent scenarios in real-world settings is challenging. The authors propose a decentralized model-based policy optimization framework to enable scalable decision-making.
Keyword:
WIRELESS NETWORKS
MULTIAGENT
ALGORITHM
SYSTEMS
SHOGI
LEVEL
CHESS
MODEL
GO

期刊

Nature Machine Intelligence 封面图
Nature Machine Intelligence
IF:
23.9
论文数:
1.3K
被引数:
1.5W

机构

U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

Antarctic climate change and the environment: an update南极气候变化与环境: 最新动态
err2013-04-18
err0
errOAAI
errJohn Turner; Nicholas E. Barrand; Thomas J. Bracegirdle; Peter Convey; Dominic A. Hodgson; Martin Jarvis; Adrian Jenkins; Gareth Marshall; Michael P. Meredith; Howard Roscoe; Jon Shanklin; John French; Hugues Goosse; Mauro Guglielmin; Julian Gutt; Stan Jacobs; Marlon C. Kennicutt; Valerie Masson-Delmotte; Paul Mayewski; Francisco Navarro; Sharon Robinson; Ted Scambos; Mike Sparrow; Colin Summerhayes; Kevin Speer; Alexander Klepikov
err分享
err收藏
A frequency analysis of light transport
err2005-07-01
err0
errOAAI
errFrédo Durand; Nicolas Holzschuch; Cyril Soler; Eric Chan; François X. Sillion
err分享
err收藏
Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
err分享
err收藏
S1-Leitlinie Post-COVID/Long-COVIDS1-Leitlinie后COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
err分享
err收藏
err分享
err收藏
学者 查看更多内容