arrow
Return

Value iteration algorithm for continuous-time linear quadratic stochastic optimal control problems

delete2024-01-25
delete2
PRE
AI
G
Guangchen Wang
H
Heng Zhang *
DOI:10.1007/s11432-023-3820-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this study, we investigate a continuous-time infinite-horizon linear quadratic stochastic optimal control problem with multiplicative noise in control and state variables. Using the techniques of stochastic stability, exact observability, and stochastic approximation, a value iteration algorithm is developed to solve the corresponding generalized algebraic Riccati equation. Unlike the existing policy iteration algorithm, this algorithm does not rely on an initial stabilizing control. Further, this algorithm can also be used to compute policy evaluation steps that arise in the policy iteration algorithm. Herein, a simulation example is provided to validate the obtained results.
Keywords:
stochastic systems
optimal control
linear quadratic stochastic problem
generalized algebraic Riccati equation
value iteration algorithm

Journal

Science China Information Sciences cover
Science China Information Sciences
IF:
7.6
Papers:
4.9K
Citations:
8.9K

Organization

S
shandong university
Scholars:
9.5W
Papers: 6.4W
Citations: 94
Cited Papers

Cited Papers

Discrete-Time Local Value Iteration Adaptive Dynamic Programming: Convergence Analysis
err2018-06-01
err134
PREAI
errWei, Qinglai; Lewis, Frank L.; Liu, Derong; Song, Ruizhuo; Lin, Hanquan
errShare
errSave
errShare
errSave
Structure of the C-Terminal Domain of Human La Protein Reveals a Novel RNA Recognition Motif Coupled to a Helical Nuclear Retention Element
err2003-07-01
err0
errOAAI
errAmanda Jacks; Jeff Babon; Geoff Kelly; Ioannis Manolaridis; Peter D Cary; Stephen Curry; Maria R Conte
errShare
errSave
errShare
errSave
researcher View more