arrow
返回

Robust Adaptive Dynamic Programming Control for Uncertain Discrete-Time Nonlinear Systems

delete2025-02-01
delete0
PRE
AI
P
Peng Zhang
M
Mou Chen *
郑
郑子萱 (Zixuan Zheng)
DOI:10.1109/TSMC.2024.3495821delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article studies two robust adaptive dynamic programming (ADP) approaches for uncertain discrete-time (DT) nonlinear systems. Since the uncertainty is implicit in the traditional Hamilton-Jacobi-Bellman (HJB) equation, it is difficult to deal with the uncertainty. In this article, the Taylor series approximation technique is utilized to convert the traditional HJB equation into an explicit form of the uncertainty. In virtue of the first-order Taylor series approximation technique, a robust first-order approximate HJB equation is established. To further improve the approximation accuracy, a robust second-order approximate HJB equation is exploited by using the Hessian matrix of the value function. It is shown that the second-order approximate HJB equation could be extended to the uncertain DT linear systems. Aiming at obtaining the solutions of the two robust approximate HJB equations, we propose two corresponding policy iteration (PI) algorithms. More importantly, the convergence and optimality of the designed PI algorithms are clarified. Finally, a numerical case is conducted to test the validity of the designed robust DT PI ADP approaches.
Keyword:
Approximate Hamilton-Jacobi-Bellman (HJB) equation
policy iteration (PI) algorithm
robust adaptive dynamic programming (ADP)
uncertain discrete-time (DT) nonlinear systems
Approximate Hamilton-Jacobi-Bellman (HJB) equation
policy iteration (PI) algorithm
robust adaptive dynamic programming (ADP)
uncertain discrete-time (DT) nonlinear systems

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

The Effect of Haptic Support Systems on Driver Performance: A Literature Survey
err2015-10-01
err0
errOAAI
errSebastiaan M. Petermeijer; David A. Abbink; Mark Mulder; Joost C. F. de Winter
err分享
err收藏
Hamiltonian-Driven Hybrid Adaptive Dynamic Programming哈密顿驱动的混合自适应动态规划
err2021-10-01
err52
errOAAI
errYang, Yongliang; Vamvoudakis, Kyriakos G.; Modares, Hamidreza; Yin, Yixin; Wunsch, Donald C.
err分享
err收藏
学者 查看更多内容