arrow
Return

A Novel Online Adaptive Dynamic Programming Algorithm With Adjustable Convergence Rate

delete2024-03-01
delete4
delete
OA
AI
Y
Yonghua Wang
Z
Zheliang Zhang
Y
Yongwei Zhang
M
Mingming Liang
D
Derong Liu *
DOI:10.1109/TCSI.2023.3346029delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article develops a novel online adaptive dynamic programming algorithm with adjustable convergence rate to address the optimal control problem of nonlinear systems. Relaxation factors are introduced to tune the convergence rate of value function sequence online. A novel update law based on recursive least squares is developed to adjust the weight of critic neural network at the sampling instant. The uniform ultimate boundedness of the neural network estimation error and the closed-loop system state are analyzed by utilizing the Lyapunov technique. Finally, the effectiveness of the present algorithm is demonstrated by executing three simulation examples.
Keywords:
Adaptive dynamic programming
discrete-time nonlinear systems
convergence rate
online optimal control
neural networks

Journal

IEEE Transactions on Circuits and Systems I-Regular Papers cover
IEEE Transactions on Circuits and Systems I-Regular Papers
IF:
5.2
Papers:
9.7K
Citations:
2.2W

Organization

G
guangdong university of technology
Scholars:
3.0W
Papers: 2.0W
Citations: 36
S
South China Agricultural University
Scholars:
3.1W
Papers: 1.5W
Citations: 2.6W