.png){kind=icon}
Return
Trajectory Based Prioritized Double Experience Buffer for Sample-Efficient Policy Optimization
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3097357.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Reinforcement learning has recently made great progress in various challenging domains such as board game of Go and MOBA game of StarCraft II. Policy gradient based reinforcement learning method has become the mainstream due to its effectiveness and simplicity both in discrete and continuous scenarios. However, policy gradient methods commonly involve function approximation and work in an on-policy fashion, which leads to high variance and low sample efficiency. This paper introduces a novel policy gradient method to improve the sample efficiency via a pair of trajectory based prioritized replay buffers and reduce the variance in training with a target network whose weights are updated in a soft manner. We evaluate our method on the reinforcement learning suit of Open AI Gym tasks, and the results show that the proposed method can learn more steadily and achieve higher performance than existing methods.
Keywords:
Trajectory
Training
Reinforcement learning
Optimization
Linear programming
Gradient methods
Games
Reinforcement learning
policy gradient
replay buffer
distributed RL
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
Cited Papers
.png){kind=icon}
ShareSave no more
no more