.png){kind=icon}
返回
Data-Driven Stochastic Optimal Control With Safety Constraints Using Linear Transfer Operators
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2023.3288623.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this article, we provide a data-driven framework for optimal control of a continuous-time control-affine stochastic dynamical system. The proposed framework relies on the linear operator theory involving Perron-Frobenius (P-F) and Koopman operators. Our first result involving the P-F operator provides a convex formulation to the optimal control problem in the dual space of densities. This convex formulation of the stochastic optimal control problem leads to an infinite-dimensional convex program. The finite-dimensional approximation of the convex program is obtained using a data-driven approximation of the linear operators. Our second results demonstrate using the Koopman operator, dual to the P-F operator, for the stochastic optimal control design. We show that the Hamilton-Jacobi-Bellman (HJB) equation can be expressed using the Koopman operator. We provide an iterative procedure along the lines of a popular policy iteration algorithm based on the data-driven approximation of the Koopman operator for solving the HJB equation. Finally, we present examples to demonstrate the efficacy of the developed framework and verify the convergence rates for the operator and optimal control numerically.
Keyword:
Linear transfer operators
nonlinear systems
stochastic optimal control
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control非线性动力系统的线性预测器: Koopman算子满足模型预测控制.png)
AUTOMATICA
OAAI
AUTOMATICAIF5.9
OAAI分享收藏HCC1, a Polygalacturonase, Regulates Chlorophyll Degradation via the Ethylene Synthesis PathwayRice
OAAI
RiceIF0
OAAI分享收藏Koopman operator-based model reduction for switched-system control of PDEs基于Koopman算子的pde切换系统控制模型约简AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏
查看更多内容