.png){kind=icon}
返回
NEWTON METHOD FOR STOCHASTIC CONTROL PROBLEMS
.png){kind=icon}
OA
AI
DOI：10.1137/21M1408567.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We develop a new iterative method based on the Pontryagin principle to solve stochastic control problems. This method is nothing other than the Newton method extended to the framework of stochastic optimal control, where the state dynamics are given by an ODEs with stochastic coefficients and the cost is random. Each iteration of the method is made of two ingredients: computing the Newton direction, and finding an adapted step length. The Newton direction is obtained by solving an affine-linear Forward-Backward Stochastic Differential Equation (FBSDE) with random coefficients. This is done in the setting of a general filtration. Solving such an FBSDE reduces to solving a Riccati Backward Stochastic Differential Equation (BSDE) and an affine-linear BSDE, as expected in the framework of linear FBSDEs or Linear-Quadratic stochastic control problems. We then establish convergence results for this Newton method. In particular, Lipschitz-continuity of the second-order derivative of the cost functional is established with an appropriate choice of norm and under boundedness assumptions, which is sufficient to prove (local) quadratic convergence of the method in the space of uniformly bounded processes. To choose an appropriate step length while fitting our choice of space of processes, an adapted Backtracking line search method is developed. We then prove global convergence of the Newton method with the proposed line search procedure, which occurs at a quadratic rate after finitely many iterations. An implementation with regression techniques to solve BSDEs arising in the computation of the Newton step is developed. We apply it to the control problem of a large number of batteries providing ancillary services to an electricity network.
Keyword:
Newton method
stochastic optimal control
Forward-Backward Stochastic Differential Equations
Backward Stochastic Differential Equations
empirical regression
energy management
期刊
IF:
2.3
论文数:
27
被引数:
1.0W
机构
引用论文
Neural stem cell-mediated CE/CPT-11 enzyme/prodrug therapy in transgenic mouse model of intracerebellar medulloblastoma.png)
Gene Therapy
OAAI
Gene TherapyIF0
OAAI分享收藏Iron Labeling and Pre-Clinical MRI Visualization of Therapeutic Human Neural Stem Cells in a Murine Glioma ModelPLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容