arrow
返回

Gaussian process dynamic programming

delete2009-03-01
delete162
delete
OA
AI
M
Marc Peter Deisenroth *
C
Carl Edward Rasmussen
J
Jan Peters
DOI:10.1016/j.neucom.2008.12.019delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Reinforcement learning (RL) and optimal control of systems with continuous states and actions require approximation techniques in most interesting cases. In this article, we introduce Gaussian process dynamic programming (GPDP), an approximate value function-based RL algorithm. We consider both a classic optimal control problem, where problem-specific prior knowledge is available, and a classic RL problem, where only very general priors can be used. For the classic optimal control problem. GPDP models the unknown value functions with Gaussian processes and generalizes dynamic programming to continuous-valued states and actions. For the RL problem, GPDP starts from a given initial state and explores the state space using Bayesian active learning. To design a fast learner, available data have to be used efficiently. Hence, we propose to learn probabilistic models of the a priori unknown transition dynamics and the value functions on the fly. In both cases, we successfully apply the resulting continuous-valued controllers to the under-actuated pendulum swing up and analyze the performances of the suggested algorithms. It turns out that GPDP uses data very efficiently and can be applied to problems, where classic dynamic programming would be cumbersome. (C) 2009 Elsevier B.V. All rights reserved.
Keyword:
Reinforcement learning
Optimal control
Dynamic programming
Gaussian processes
Bayesian active learning
Policy learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
M
Max Planck Society
学者数:
8.2W
论文数: 7.7W
被引数: 3.3W
引用论文

引用论文

Synthesis, spectroscopic and structural characterization of Cu(II) derivatives of tris(pyrazol-1-yl)methanes
err2002-05-01
err0
PREAI
errDomenico Martini; Maura Pellei; Claudio Pettinari; Brian W. Skelton; Allan H. White
err分享
err收藏
err分享
err收藏
Mechanism of Surface White Discoloration of Peeled (Minimally Processed) Carrots During Storage
err2006-08-26
err0
PREAI
errLUIS CISNEROS‐ZEVALLOS; MIKAL E. SALTVEIT; JOHN M. KROCHTA
err分享
err收藏
Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
Unscented filtering and nonlinear estimation
err2004-03-01
err5.4K
errOAAI
errJulier, SJ; Uhlmann, JK
err分享
err收藏
High-pressure static and dynamic properties of theR3¯cphase of solid nitrogen
err1986-06-15
err0
PREAI
errR. D. Etters; V. Chandrasekharan; E. Uzan; K. Kobashi
err分享
err收藏
Functional outcome following liver transplantation—A pilot study
err2008-03-01
err0
PREAI
errRonan E. O'Carroll; Fiona Turner; Kirsty Flatley; Lesley M. McGregor; Peter C. Hayes
err分享
err收藏
Calculations of magnetic x-ray dichroism in the 3dabsorption spectra of rare-earth compounds
err1988-02-01
err0
errOAAI
errJ. B. Goedkoop; B. T. Thole; G. van der Laan; G. A. Sawatzky; F. M. F. de Groot; J. C. Fuggle
err分享
err收藏
err分享
err收藏
学者 查看更多内容