.png){kind=icon}
返回
Hamiltonian-Driven Adaptive Dynamic Programming With Approximation Errors
.png){kind=icon}
OA
AI
DOI：10.1109/TCYB.2021.3108034.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this article, we consider an iterative adaptive dynamic programming (ADP) algorithm within the Hamiltonian-driven framework to solve the Hamilton-Jacobi-Bellman (HJB) equation for the infinite-horizon optimal control problem in continuous time for nonlinear systems. First, a novel function, ``min-Hamiltonian,'' is defined to capture the fundamental properties of the classical Hamiltonian. It is shown that both the HJB equation and the policy iteration (PI) algorithm can be formulated in terms of the min-Hamiltonian within the Hamiltonian-driven framework. Moreover, we develop an iterative ADP algorithm that takes into consideration the approximation errors during the policy evaluation step. We then derive a sufficient condition on the iterative value gradient to guarantee closed-loop stability of the equilibrium point as well as convergence to the optimal value. A model-free extension based on an off-policy reinforcement learning (RL) technique is also provided. Finally, numerical results illustrate the efficacy of the proposed framework.
Keyword:
Costs
Mathematical model
Stability analysis
Approximation error
Approximation algorithms
Dynamic programming
Iterative algorithms
Hamilton-Jacobi-Bellman (HJB) equation
Hamiltonian-driven framework
inexact adaptive dynamic programming (ADP)
optimal control
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Data-Based Reinforcement Learning for Nonzero-Sum Games With Unknown Drift Dynamics基于数据的具有未知漂移动态的非零和游戏的强化学习
PREAI
分享收藏
Finite-Approximation-Error-Based Discrete-Time Iterative Adaptive Dynamic Programming基于有限近似误差的离散时间迭代自适应动态规划
PREAI
分享收藏Adaptive dynamic programming and optimal control of nonlinear nonaffine systems自适应动态规划与非线性非仿射系统的最优控制.png)
AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Adaptive optimal control for continuous-time linear systems based on policy iteration基于策略迭代的连续时间线性系统自适应最优控制AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Error Bound Analysis of Q-Function for Discounted Optimal Control Problems With Policy Iteration
PREAI
分享收藏
查看更多内容