.png){kind=icon}
返回
Implicit incremental natural actor critic algorithm
.png){kind=icon}
OA
AI
DOI：10.1016/j.neunet.2018.10.007.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Natural policy gradient (NPG) methods are promising approaches to finding locally optimal policy parameters. The NPG approach works well in optimizing complex policies with high-dimensional parameters, and the effectiveness of NPG methods has been demonstrated in many fields. However, the incremental estimation of the NPG is computationally unstable owing to its high sensitivity to the step-sizes values, especially to the one used to update the estimate of NPG. In this study, we propose a new incremental and stable algorithm for the NPG estimation. We call the proposed algorithm the implicit incremental natural actor critic (I2NAC), and it is based on the idea of the implicit update. The convergence analysis for I2NAC is provided. Theoretical analysis results indicate the stability of I2NAC and the instability of conventional incremental NPG methods. Numerical experiments were performed, and the results show that I2NAC is less sensitive to the values of the meta-parameters, including the step-size for the NPG update, compared to the existing incremental NPG method. (C) 2018 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license.
Keyword:
Reinforcement learning
Natural policy gradient
Natural actor critic
Incremental learning
Implicit update
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
7.8K
被引数:
3.0W
机构
引用论文
分享收藏Current status of materials development of nuclear fuel cladding tubes for light water reactors
PREAI
分享收藏分享收藏New method for assessing cardiac parasympathetic activity using 24 hour electrocardiograms..png)
HeartOAAI
HeartIF0
OAAI分享收藏Autophagy execution protein beclin1 regulates radiation-induced osteopontin in human lung cancer cellLung Cancer
Lung CancerIF0
PREAI
分享收藏
查看更多内容