Return
Data-Driven Policy Iteration for Nonlinear Optimal Control Problems
DOI:10.1109/TNNLS.2022.3142501.png)
Abstract
En 中文
The design of optimal control laws for nonlinear systems is tackled without knowledge of the underlying plant and of a functional description of the cost function. The proposed data-driven method is based only on real-time measurements of the state of the plant and of the (instantaneous) value of the reward signal and relies on a combination of ideas borrowed from the theories of optimal and adaptive control problems. As a result, the architecture implements a policy iteration strategy in which, hinging on the use of neural networks, the policy evaluation step and the computation of the relevant information instrumental for the policy improvement step are performed in a purely continuous-time fashion. Furthermore, the desirable features of the design method, including convergence rate and robustness properties, are discussed. Finally, the theory is validated via two benchmark numerical simulations.
Keywords:
Optimal control
Costs
Neural networks
Real-time systems
Nonlinear dynamical systems
Closed loop systems
Learning systems
Data-driven methods
nonlinear systems
optimal control
policy iteration
Journal
IF:
8.9
Papers:
7.6K
Citations:
7.2W
Organization
Cited Papers
A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems
AUTOMATICA
IF5.9

