arrow
Return

Acceleration for Deep Reinforcement Learning using Parallel and Distributed Computing: A Survey

delete2024-12-10
delete0
delete
OA
AI
Z
Zhihong Liu
徐鑫 cover
徐鑫 (Xin Xu)
P
Peng Qiao
D
Dongsheng Li
DOI:10.1145/3703453delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep reinforcement learning has led to dramatic breakthroughs in the field of artificial intelligence for the past few years. As the amount of rollout experience data and the size of neural networks for deep reinforcement learning have grown continuously, handling the training process and reducing the time consumption using parallel and distributed computing is becoming an urgent and essential desire. In this article, we perform a broad and thorough investigation on training acceleration methodologies for deep reinforcement learning based on parallel and distributed computing, providing a comprehensive survey in this field with state-ofthe-art methods and pointers to core references. In particular, a taxonomy of literature is provided, along with a discussion of emerging topics and open issues. This incorporates learning system architectures, simulation parallelism, computing parallelism, distributed synchronization mechanisms, and deep evolutionary reinforcement learning. Furthermore, we compare 16 current open-source libraries and platforms with criteria of facilitating rapid development. Finally, we extrapolate future directions that deserve further research.
Keywords:
Deep reinforcement learning
acceleration
parallel and distributed computing
large-scale

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.4K
Citations:
3.5W

Organization

S
Southwest Univ
Scholars:
3.0K
Papers: 1.0K
Citations: 340