arrow
Return

Improved value iteration for nonlinear tracking control with accelerated learning

delete2024-01-03
delete0
PRE
AI
王丁 (Ding Wang) *
Y
Yuan Wang
M
Mingming Ha
J
Jin Ren
J
Junfei Qiao
DOI:10.1002/rnc.7183delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, an adaptive critic scheme with a novel performance index function is developed to solve the tracking control problem, which eliminates the tracking error and possesses the adjustable convergence rate in the offline learning process. Under some conditions, the convergence and monotonicity of the accelerated value function sequence can be guaranteed. Combining the advantages of the adjustable and general value iteration schemes, an integrated algorithm is proposed with a fast guaranteed convergence, which involves two stages, namely the acceleration stage and the convergence stage. Moreover, an effective approach is given to adaptively determine the acceleration interval. With this operation, the fast convergence of the new value iteration scheme can be fully utilized. Finally, compared with the general value iteration, the numerical results are presented to verify the fast convergence and the tracking performance of the developed adaptive critic design.
Keywords:
adaptive critic designs
adaptive dynamic programming
fast convergence
nonlinear tracking control
value iteration

Journal

International Journal of Robust and Nonlinear Control cover
International Journal of Robust and Nonlinear Control
IF:
3.2
Papers:
6.9K
Citations:
1.4W

Organization

B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W