arrow
返回

Online adaptive algorithm for optimal control with integral reinforcement learning

delete2013-05-09
delete127
PRE
AI
K
Kyriakos G. Vamvoudakis *
D
Draguna Vrabie
F
Frank L. Lewis
DOI:10.1002/rnc.3018delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we introduce an online algorithm that uses integral reinforcement knowledge for learning the continuous-time optimal control solution for nonlinear systems with infinite horizon costs and partial knowledge of the system dynamics. This algorithm is a data-based approach to the solution of the Hamilton-Jacobi-Bellman equation, and it does not require explicit knowledge on the system's drift dynamics. A novel adaptive control algorithm is given that is based on policy iteration and implemented using an actor/critic structure having two adaptive approximator structures. Both actor and critic approximation networks are adapted simultaneously. A persistence of excitation condition is required to guarantee convergence of the critic to the actual optimal value function. Novel adaptive control tuning algorithms are given for both critic and actor networks, with extra terms in the actor tuning law being required to guarantee closed loop dynamical stability. The approximate convergence to the optimal controller is proven, and stability of the system is also guaranteed. Simulation examples support the theoretical result. Copyright (c) 2013 John Wiley & Sons, Ltd.
Keyword:
synchronous integral reinforcement learning
Hamilton-Jacobi-Bellman equation
persistence of excitation
approximated dynamic programming
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Robust and Nonlinear Control 封面图
International Journal of Robust and Nonlinear Control
IF:
3.2
论文数:
7.0K
被引数:
1.4W

机构

R
rtx corporation
学者数:
391
论文数: 315
被引数: 0
U
University of California Santa Barbara
学者数:
1.2W
论文数: 9.6K
被引数: 3.6W
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Moats and Drawbridges: An Isolation Primitive for Reconfigurable Hardware Based Systems
err2007-05-01
err0
errOAAI
errTed Huffmire; Brett Brotherton; Gang Wang; Timothy Sherwood; Ryan Kastner; Timothy Levin; Thuy Nguyen; Cynthia Irvine
err分享
err收藏
学者 查看更多内容