返回
Robust Adaptive Dynamic Programming Control for Uncertain Discrete-Time Nonlinear Systems
DOI:10.1109/TSMC.2024.3495821.png)
摘要
En 中文
This article studies two robust adaptive dynamic programming (ADP) approaches for uncertain discrete-time (DT) nonlinear systems. Since the uncertainty is implicit in the traditional Hamilton-Jacobi-Bellman (HJB) equation, it is difficult to deal with the uncertainty. In this article, the Taylor series approximation technique is utilized to convert the traditional HJB equation into an explicit form of the uncertainty. In virtue of the first-order Taylor series approximation technique, a robust first-order approximate HJB equation is established. To further improve the approximation accuracy, a robust second-order approximate HJB equation is exploited by using the Hessian matrix of the value function. It is shown that the second-order approximate HJB equation could be extended to the uncertain DT linear systems. Aiming at obtaining the solutions of the two robust approximate HJB equations, we propose two corresponding policy iteration (PI) algorithms. More importantly, the convergence and optimality of the designed PI algorithms are clarified. Finally, a numerical case is conducted to test the validity of the designed robust DT PI ADP approaches.
Keyword:
Approximate Hamilton-Jacobi-Bellman (HJB) equation
policy iteration (PI) algorithm
robust adaptive dynamic programming (ADP)
uncertain discrete-time (DT) nonlinear systems
Approximate Hamilton-Jacobi-Bellman (HJB) equation
policy iteration (PI) algorithm
robust adaptive dynamic programming (ADP)
uncertain discrete-time (DT) nonlinear systems
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems With Disturbances具有扰动的未知系统最优控制的非策略参与者-批评者结构
Near-Nash Equilibrium Control Strategy for Discrete-Time Nonlinear Systems With Round-Robin Protocol
SDO-Based Command Filtered Adaptive Neural Tracking Control for MIMO Nonlinear Systems With Time-Varying Constraints时变约束MIMO非线性系统的SDO指令滤波自适应神经跟踪控制
Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems线性系统的自适应动态规划和自适应最优输出调节

