.png){kind=icon}
返回
Approximate Optimal Trajectory Tracking With Sparse Bellman Error Extrapolation
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2022.3194040.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with uncertain drift dynamics. A model-based approximate dynamic programming (ADP) approach, which is facilitated using a concurrent learning-based system identifier, approximates the optimal value function. To reduce the computational complexity of model-based ADP, the state space is segmented into user-defined segments (i.e., regions). Off-policy trajectories are selected within each segment to facilitate learning of the value function weight estimates; this process is called Bellman error (BE) extrapolation. Within certain segments of the state space, sparse neural networks are used to reduce the computational expense of BE extrapolation. Discontinuities occur in the weight update laws since different groupings of extrapolated BE trajectories are active in certain regions of the state space. A Lyapunov-like stability analysis is presented to prove boundedness of the overall system in the presence of discontinuities. Simulation results are included to demonstrate the performance and validity of the developed method. The simulation results demonstrate that using the sparse, switched BE extrapolation method developed in this article reduces the computation time by 85.6% when compared to the traditional BE extrapolation method.
Keyword:
Extrapolation
Aerospace electronics
Function approximation
Computational modeling
Trajectory
Optimal control
Mathematical models
Adaptive control
nonlinear control
optimal control
reinforcement learning
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
Data-based reinforcement learning approximate optimal control for an uncertain nonlinear system with control effectiveness faults.png)
AUTOMATICA
OAAI
AUTOMATICAIF5.9
OAAI分享收藏Model-based reinforcement learning for approximate optimal regulation基于模型的强化学习的近似最优调节AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏
Isoniazid Blood Levels in Patients with Pulmonary Tuberculosis at a Tuberculosis Referral CenterChemotherapy
ChemotherapyIF0
PREAI
分享收藏Analysis of a New Expansive Soils Stabilization Method Made from Eco-Cement and Fiber Reinforcement
PREAI
分享收藏分享收藏Efficient model-based reinforcement learning for approximate online optimal control基于模型的有效强化学习用于近似在线最优控制AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏
查看更多内容