arrow
返回

Parameter-exploring policy gradients

delete2010-05-01
delete178
delete
OA
AI
C
Christian Osendorfer
T
Thomas Rückstieß
A
Alex Graves
J
Jan Peters
J
Jürgen Schmidhuber
DOI:10.1016/j.neunet.2009.12.004delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We present a model-free reinforcement learning method for partially observable Markov decision problems. Our method estimates a likelihood gradient by sampling directly in parameter space, which leads to lower variance gradient estimates than obtained by regular policy gradient methods. We show that for several complex control tasks, including robust standing with a humanoid robot, this method outperforms well-known algorithms from the fields of standard policy gradients, finite difference methods and population based heuristics. We also show that the improvement is largest when the parameter samples are drawn symmetrically. Lastly we analyse the importance of the individual components of our method by incrementally incorporating them into the other algorithms, and measuring the gain in performance after each step. (C) 2009 Elsevier Ltd. All rights reserved.
Keyword:
Policy gradients
Stochastic optimisation
Reinforcement learning
Robotics
Control
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

T
Technical University of Munich
学者数:
5.2W
论文数: 3.9W
被引数: 6.2W
M
Max Planck Society
学者数:
8.2W
论文数: 7.7W
被引数: 3.3W
引用论文

引用论文

Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
Trade-offs in Robustness to Perturbations of Bacterial Population Controllers
err
IF0
err2020-06-05
err0
errOAAI
errCameron McBride; Domitilla Del Vecchio
err分享
err收藏
Dietary Fibre Redefined
err1976-05-22
err0
PREAI
errEdmund W. Godding
err分享
err收藏
NeuroGrid: recording action potentials from the surface of the brainNeuroGrid: 记录来自大脑表面的动作电位
err2014-12-22
err0
errOAAI
errDion Khodagholy; Jennifer N Gelinas; Thomas Thesen; Werner Doyle; Orrin Devinsky; George G Malliaras; György Buzsáki
err分享
err收藏
A Soft Chemistry Approach to Coating of LiFePO4 with a Conducting Polymer
err2011-06-10
err0
errOAAI
errDavid Lepage; Christophe Michot; Guoxian Liang; Michel Gauthier; Steen B. Schougaard
err分享
err收藏
Synthesis of homodinuclear macrocyclic complexes of lanthanides and phenolic schiff bases
err1986-08-01
err0
PREAI
errIshenkumba A. Kahwa; Joel Selbin; Thomas C.-Y. Hsieh; Roger A. Laine
err分享
err收藏
Reinforcement learning of motor skills with policy gradients
err2008-05-01
err628
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
没有更多内容