arrow
Return

Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors

delete2018-04-01
delete44
PRE
AI
Q
Qinglai Wei *
B
Benkai Li
宋睿卓 cover
宋睿卓 (Ruizhuo Song)
DOI:10.1109/TNNLS.2017.2661865delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, a generalized policy iteration (GPI) algorithm with approximation errors is developed for solving infinite horizon optimal control problems for nonlinear systems. The developed stable GPI algorithm provides a general structure of discrete-time iterative adaptive dynamic programming algorithms, by which most of the discrete-time reinforcement learning algorithms can be described using the GPI structure. It is for the first time that approximation errors are explicitly considered in the GPI algorithm. The properties of the stable GPI algorithm with approximation errors are analyzed. The admissibility of the approximate iterative control law can be guaranteed if the approximation errors satisfy the admissibility criteria. The convergence of the developed algorithm is established, which shows that the iterative value function is convergent to a finite neighborhood of the optimal performance index function, if the approximate errors satisfy the convergence criterion. Finally, numerical examples and comparisons are presented.
Keywords:
Adaptive critic designs
adaptive dynamic programming (ADP)
approximate dynamic programming
generalized policy iteration (GPI)
neural networks
neurodynamic programming
nonlinear systems
optimal control
reinforcement learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems With Disturbances
err2016-05-01
err196
PREAI
errSong, Ruizhuo; Lewis, Frank L.; Wei, Qinglai; Zhang, Huaguang
errShare
errSave
Discrete-Time Local Value Iteration Adaptive Dynamic Programming: Convergence Analysis
err2018-06-01
err134
PREAI
errWei, Qinglai; Lewis, Frank L.; Liu, Derong; Song, Ruizhuo; Lin, Hanquan
errShare
errSave
errShare
errSave
researcher View more