arrow
Return

Data-driven control for stochastic linear-quadratic optimal problem with completely unknown dynamics

delete2025-03-10
delete0
PRE
AI
Y
Yanlin Chen *
W
Weiyao Lan *
DOI:10.1080/00207721.2025.2474137delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This study presents an off-policy iteration approach for finding adaptive optimal control policies online for continuous-time stochastic linear systems with completely unknown system dynamics. The proposed approach employs the approximate/adaptive dynamic programming technique to iteratively solve the stochastic algebraic Riccati equation using the online information of state and input, without requiring the priori knowledge of the system matrices. In addition, all iterations can be conducted by repeatedly using the same state and input information in some fixed time intervals. Theoretical guarantees are given for the stability of the closed-loop system and the convergence of the algorithm. Finally, the application of the proposed algorithm for two examples validates its feasibility and effectiveness.
Keywords:
Stochastic optimal control
adaptive dynamic programming
stochastic algebra equation
continuous-time system

Journal

I
International Journal of Systems Science
IF:
4.6
Papers:
1.1K
Citations:
7.3K

Organization

X
xiamen university
Scholars:
5.8W
Papers: 3.8W
Citations: 67