.png){kind=icon}
Return
Approximate Optimal Trajectory Tracking With Sparse Bellman Error Extrapolation
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2022.3194040.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This article provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with uncertain drift dynamics. A model-based approximate dynamic programming (ADP) approach, which is facilitated using a concurrent learning-based system identifier, approximates the optimal value function. To reduce the computational complexity of model-based ADP, the state space is segmented into user-defined segments (i.e., regions). Off-policy trajectories are selected within each segment to facilitate learning of the value function weight estimates; this process is called Bellman error (BE) extrapolation. Within certain segments of the state space, sparse neural networks are used to reduce the computational expense of BE extrapolation. Discontinuities occur in the weight update laws since different groupings of extrapolated BE trajectories are active in certain regions of the state space. A Lyapunov-like stability analysis is presented to prove boundedness of the overall system in the presence of discontinuities. Simulation results are included to demonstrate the performance and validity of the developed method. The simulation results demonstrate that using the sparse, switched BE extrapolation method developed in this article reduces the computation time by 85.6% when compared to the traditional BE extrapolation method.
Keywords:
Extrapolation
Aerospace electronics
Function approximation
Computational modeling
Trajectory
Optimal control
Mathematical models
Adaptive control
nonlinear control
optimal control
reinforcement learning
Journal
IF:
7
Papers:
1.3W
Citations:
6.7W
Organization
Cited Papers
ShareSaveData-based reinforcement learning approximate optimal control for an uncertain nonlinear system with control effectiveness faults.png)
AUTOMATICA
OAAI
AUTOMATICAIF5.9
OAAIShareSave
Isoniazid Blood Levels in Patients with Pulmonary Tuberculosis at a Tuberculosis Referral CenterChemotherapy
ChemotherapyIF0
PREAI
ShareSaveAnalysis of a New Expansive Soils Stabilization Method Made from Eco-Cement and Fiber Reinforcement
PREAI
ShareSaveShareSaveEfficient model-based reinforcement learning for approximate online optimal controlAUTOMATICAOAAI
AUTOMATICAIF5.9
OAAIShareSave
View more