arrow
返回

Trajectory Based Prioritized Double Experience Buffer for Sample-Efficient Policy Optimization

delete2021-01-01
delete2
delete
OA
AI
S
Shengxiang Li
O
Ou Li *
G
Guangyi Liu
S
Siyuan Ding
Y
Yijie Bai
DOI:10.1109/ACCESS.2021.3097357delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Reinforcement learning has recently made great progress in various challenging domains such as board game of Go and MOBA game of StarCraft II. Policy gradient based reinforcement learning method has become the mainstream due to its effectiveness and simplicity both in discrete and continuous scenarios. However, policy gradient methods commonly involve function approximation and work in an on-policy fashion, which leads to high variance and low sample efficiency. This paper introduces a novel policy gradient method to improve the sample efficiency via a pair of trajectory based prioritized replay buffers and reduce the variance in training with a target network whose weights are updated in a soft manner. We evaluate our method on the reinforcement learning suit of Open AI Gym tasks, and the results show that the proposed method can learn more steadily and achieve higher performance than existing methods.
Keyword:
Trajectory
Training
Reinforcement learning
Optimization
Linear programming
Gradient methods
Games
Reinforcement learning
policy gradient
replay buffer
distributed RL
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

P
pla information engineering university
学者数:
2.8K
论文数: 1.6K
被引数: 2
引用论文

引用论文

Evidence for a Ubiquitous Seismic Discontinuity at the Base of the Mantle
err1999-11-12
err0
PREAI
errIgor Sidorin; Michael Gurnis; Don V. Helmberger
err分享
err收藏
THE [14C]DEOXYGLUCOSE METHOD FOR THE MEASUREMENT OF LOCAL CEREBRAL GLUCOSE UTILIZATION: THEORY, PROCEDURE, AND NORMAL VALUES IN THE CONSCIOUS AND ANESTHETIZED ALBINO RAT1
err2006-10-04
err0
PREAI
errL. Sokoloff; M. Reivich; C. Kennedy; M. H. Des Rosiers; C. S. Patlak; K. D. Pettigrew; O. Sakurada; M. Shinohara
err分享
err收藏
Cooperative Internet of UAVs: Distributed Trajectory Design by Multi-Agent Deep Reinforcement Learning
err2020-11-01
err117
errOAAI
errHu, Jingzhi; Zhang, Hongliang; Song, Lingyang; Schober, Robert; Poor, H. Vincent
err分享
err收藏
没有更多内容