.png){kind=icon}
返回
Hamiltonian-Driven Adaptive Dynamic Programming With Efficient Experience Replay
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2022.3213566.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article presents a novel efficient experience-replay-based adaptive dynamic programming (ADP) for the optimal control problem of a class of nonlinear dynamical systems within the Hamiltonian-driven framework. The quasi-Hamiltonian is presented for the policy evaluation problem with an admissible policy. With the quasi-Hamiltonian, a novel composite critic learning mechanism is developed to combine the instantaneous data with the historical data. In addition, the pseudo-Hamiltonian is defined to deal with the performance optimization problem. Based on the pseudo-Hamiltonian, the conventional Hamilton-Jacobi-Bellman (HJB) equation can be represented in a filtered form, which can be implemented online. Theoretical analysis is investigated in terms of the convergence of the adaptive critic design and the stability of the closed-loop systems, where parameter convergence can be achieved under a weakened excitation condition. Simulation studies are investigated to verify the efficacy of the presented design scheme.
Keyword:
Mathematical models
Optimal control
Optimization
Convergence
Iterative algorithms
Dynamic programming
Learning systems
Hamilton-Jacobi-Bellman (HJB) equation
Hamiltonian-driven adaptive dynamic programming (ADP)
pseudo-Hamiltonian
quasi-Hamiltonian
relaxed excitation condition
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Real-time reinforcement learning by sequential Actor-Critics and experience replay.png)
NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏
Adaptive cruise control via adaptive dynamic programming with experience replay通过带经验回放的自适应动态规划实现自适应巡航控制SOFT COMPUTING
SOFT COMPUTINGIF2.5
PREAI
分享收藏Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systemsAUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏
查看更多内容