arrow
返回

Stochastic Linear Quadratic Optimal Control Problem: A Reinforcement Learning Method

delete2022-09-01
delete26
delete
OA
AI
N
Na Li *
X
Xun Li
J
Jing Peng
Z
Zuo Quan Xu
DOI:10.1109/TAC.2022.3181248delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article adopts a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where the drift and diffusion terms in the dynamics may depend on both the state and control. Based on the Bellman's dynamic programming principle, we presented an online RL algorithm to attain optimal control with partial system information. This algorithm computes the optimal control, rather than estimates the system coefficients, and solves the related Riccati equation. It only requires local trajectory information, which significantly simplifies the calculation process. We shed light on our theoretical findings using two numerical examples.
Keyword:
Optimal control
Stochastic processes
Heuristic algorithms
Trajectory
Mathematics
Mathematical models
Riccati equations
Linear quadratic (LQ) problem
reinforcement learning (RL)
stochastic optimal control

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
引用论文

引用论文

err分享
err收藏
The Geography of American Poverty: Is There a Need for Place-Based Policies?
err
IF0
err2010-05-27
err0
errOAAI
errMark D. Partridge; Dan S. Rickman
err分享
err收藏
Structure of the C-Terminal Domain of Human La Protein Reveals a Novel RNA Recognition Motif Coupled to a Helical Nuclear Retention Element
err2003-07-01
err0
errOAAI
errAmanda Jacks; Jeff Babon; Geoff Kelly; Ioannis Manolaridis; Peter D Cary; Stephen Curry; Maria R Conte
err分享
err收藏
Optimal control using adaptive resonance theory and Q-learning
err2019-10-01
err12
errOAAI
errKiumarsi, Bahare; AlQaudi, Bakur; Modares, Hamidreza; Lewis, Frank L.; Levine, Daniel S.
err分享
err收藏
Analysis of Polymethylmethacrylate Destruction on High-Speed Loading
err2019-07-17
err0
PREAI
errA. M. Kugotova; B. I. Kunizhev; A. Kh. Adzhiev; A. A. Adzhieva; L. V. Kanukoeva; Z. Kh. Gaitukieva
err分享
err收藏
学者 查看更多内容