arrow
Return

Stochastic Linear Quadratic Optimal Control Problem: A Reinforcement Learning Method

delete2022-09-01
delete26
delete
OA
AI
N
Na Li *
X
Xun Li
J
Jing Peng
Z
Zuo Quan Xu
DOI:10.1109/TAC.2022.3181248delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article adopts a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where the drift and diffusion terms in the dynamics may depend on both the state and control. Based on the Bellman's dynamic programming principle, we presented an online RL algorithm to attain optimal control with partial system information. This algorithm computes the optimal control, rather than estimates the system coefficients, and solves the related Riccati equation. It only requires local trajectory information, which significantly simplifies the calculation process. We shed light on our theoretical findings using two numerical examples.
Keywords:
Optimal control
Stochastic processes
Heuristic algorithms
Trajectory
Mathematics
Mathematical models
Riccati equations
Linear quadratic (LQ) problem
reinforcement learning (RL)
stochastic optimal control

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

H
hong kong polytechnic university
Scholars:
3.0W
Papers: 4.1W
Citations: 921