arrow
Return

Data-Driven Model Predictive Control With Reinforcement Learning for Linear Time-Invariant Systems

delete2026-02-05
delete0
PRE
AI
S
Shuo Shan
孙中奇 (Zhongqi Sun) *
Y
Yuanqing Xia
DOI:10.1002/rnc.70406delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a data-driven reinforcement learning model predictive control (DD-RLMPC) scheme for linear time-invariant (LTI) systems. The scheme integrates reinforcement learning (RL) and data-driven model predictive control (DD-MPC) through value iteration. Also, a value function approximation technique is applied to approximate the terminal cost, thereby providing a direct method based on behavioral systems theory, thus using historical operation data to bypass the system identification step. The scheme first operates offline to derive the optimal approximated value function, and then operates online for controller design. Furthermore, the proposed DD-RLMPC scheme offers flexibility in selecting the prediction horizon, thus provides a potential to significantly reduce the computational burden compared to the terminal equality-constrained DD-MPC methods. We demonstrate the convergence, stability, and feasibility of the proposed DD-RLMPC scheme, with properties verified by simulation results.
Keywords:
data-driven control
learning-based control
model predictive control

Journal

International Journal of Robust and Nonlinear Control cover
International Journal of Robust and Nonlinear Control
IF:
3.2
Papers:
6.9K
Citations:
1.4W

Organization

B
Beijing Institute of Technology
Scholars:
5.2K
Papers: 2.1K
Citations: 6.0W