arrow
返回

Kernel-Based Approximate Dynamic Programming for Real-Time Online Learning Control: An Experimental Study

delete2014-01-01
delete65
PRE
AI
徐鑫 封面图
徐鑫 (Xin Xu) *
C
Chuanqiang Lian
左
左磊 (Lei Zuo)
H
Haibo He
DOI:10.1109/TCST.2013.2246866delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the past decade, there has been considerable research interest in learning control methods based on reinforcement learning (RL) and approximate dynamic programming (ADP). As an important class of function approximation techniques, kernel methods have been recently applied to improve the generalization ability of RL and ADP methods but most previous works were only based on simulation. This paper focuses on experimental studies of real-time online learning control for nonlinear systems using kernel-based ADP methods. Specifically, the kernel-based dual heuristic programming (KDHP) method is applied and tested on real-time control systems. Two kernel-based online learning control schemes are presented for uncertain nonlinear systems by using simulation data and online sampling data, respectively. Learning control experiments were performed on a single-link inverted pendulum system as well as a double-link inverted pendulum system. From the experimental results, it is shown that both online learning control schemes, either using simulation data or using real sampling data, are effective for approximating near-optimal control policies of nonlinear dynamical systems with model uncertainties. In addition, it is demonstrated that KDHP can achieve better performance than conventional DHP, which uses multilayer perceptron neural networks.
Keyword:
Approximate dynamic programming (ADP)
learning control
Markov decision processes (MDPs)
online learning
reinforcement learning (RL)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Control Systems Technology 封面图
IEEE Transactions on Control Systems Technology
IF:
3.9
论文数:
4.9K
被引数:
1.7W

机构

U
University of Rhode Island
学者数:
5.0K
论文数: 4.5K
被引数: 6.3K
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
Evidence for a Ubiquitous Seismic Discontinuity at the Base of the Mantle
err1999-11-12
err0
PREAI
errIgor Sidorin; Michael Gurnis; Don V. Helmberger
err分享
err收藏
学者 查看更多内容