arrow
Return

Self-Triggered Approximate Optimal Neuro-Control for Nonlinear Systems Through Adaptive Dynamic Programming

delete2025-03-01
delete3
delete
OA
AI
赵博 cover
赵博 (Bo Zhao)
S
Shunchao Zhang
D
Derong Liu *
DOI:10.1109/TNNLS.2024.3362800delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, a novel self-triggered approximate optimal neuro-control scheme is presented for nonlinear systems by utilizing adaptive dynamic programming (ADP). According to the Bellman principle of optimality, the cost function of the general nonlinear system is approximated by building a critic neural network with a nested updating weight vector. Thus, the Hamilton-Jacobi-Bellman equation is solved to indirectly obtain the approximate optimal neuro-control input. In order to reduce the computation, the communication bandwidth, and the energy consumption, an appropriate self-triggering condition is designed as an alternative way to predict the updating time instants of the approximate optimal neuro-control policy. On the basis of Lyapunov's direct method, the stability of the closed-loop nonlinear system is analyzed and guaranteed to be uniformly ultimately bounded. Simulation results of two practical systems illustrate the present ADP-based self-triggered approximate optimal neuro-control scheme to be reasonable and effective.
Keywords:
Adaptive dynamic programming (ADP)
neural networks (NNs)
optimal control
reinforcement learning
self-triggered control

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

B
Beijing Normal University
Scholars:
3.3W
Papers: 2.7W
Citations: 4.2W
G
Guangdong University of Finance
Scholars:
380
Papers: 427
Citations: 1.5K