返回
Efficient and scalable reinforcement learning for large-scale network control
DOI:10.1038/s42256-024-00879-7.png)
摘要
En 中文
The primary challenge in the development of large-scale artificial intelligence (AI) systems lies in achieving scalable decision-making-extending the AI models while maintaining sufficient performance. Existing research indicates that distributed AI can improve scalability by decomposing complex tasks and distributing them across collaborative nodes. However, previous technologies suffered from compromised real-world applicability and scalability due to the massive requirement of communication and sampled data. Here we develop a model-based decentralized policy optimization framework, which can be efficiently deployed in multi-agent systems. By leveraging local observation through the agent-level topological decoupling of global dynamics, we prove that this decentralized mechanism achieves accurate estimations of global information. Importantly, we further introduce model learning to reinforce the optimal policy for monotonic improvement with a limited amount of sampled data. Empirical results on diverse scenarios show the superior scalability of our approach, particularly in real-world systems with hundreds of agents, thereby paving the way for scaling up AI systems. Applying large-scale AI systems to multi-agent scenarios in real-world settings is challenging. The authors propose a decentralized model-based policy optimization framework to enable scalable decision-making.
Keyword:
WIRELESS NETWORKS
MULTIAGENT
ALGORITHM
SYSTEMS
SHOGI
LEVEL
CHESS
MODEL
GO
期刊
IF:
23.9
论文数:
1.3K
被引数:
1.5W
机构
引用论文
Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning基于多Agent深度强化学习的无线网络资源管理

