arrow
Return

Guaranteed Closed-Loop Learning in Model Predictive Control

delete2023-02-01
delete6
PRE
AI
R
Raffaele Soloperto *
M
Matthias A. Müller
F
Frank Allgöwer
DOI:10.1109/TAC.2022.3172453delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, we propose a novel learning-based model predictive control framework for nonlinear systems which is able to guarantee closed-loop learning of the controlled system. We consider a cost function that combines a general economic cost with a user-defined learning cost function that aims at incentivizing learning of the unknown system. In particular, due to the finite horizon of the MPC scheme and to the presence of disturbances, the open-loop trajectory usually differs from the closed-loop one. Such a mismatch causes existing learning-based MPC schemes to only show a learning phase in the open-loop prediction, without providing any formal guarantee on the actual closed-loop learning. In this article, we show how existing MPC schemes can be easily modified in order to guarantee closed-loop learning of the system by including a suitable discount factor in the chosen learning cost function, and implementing an additional constraint in the original MPC scheme. We show that various techniques for online learning the system dynamics, such as kinky inference methods, Gaussian processes, or parametric approaches, can be used within the proposed general framework.
Keywords:
Cost function
Costs
Uncertainty
Trajectory
Control systems
Predictive models
Predictive control
Constrained control
closed loop learning
predictive control for nonlinear systems
nonlinear systems

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

U
University of Stuttgart
Scholars:
1.1W
Papers: 9.4K
Citations: 1.3W
L
Leibniz University Hannover
Scholars:
1.1W
Papers: 8.5K
Citations: 1.1W
Cited Papers

Cited Papers

errShare
errSave
Symptomatic Marginal Ulcer Disease After Roux-en-Y Gastric Bypass: Incidence, Risk Factors and Management
err2014-11-08
err0
PREAI
errUsha K. Coblijn; Sjoerd M. Lagarde; Steve M. M. de Castro; Sjoerd D. Kuiken; Bart A. van Wagensveld
errShare
errSave
A set-theoretic generalization of dissipativity with applications in Tube MPC
err2020-12-01
err7
errOAAI
errVillanueva, Mario Eduardo; De Lazzari, Elena; Mueller, Matthias A.; Houska, Boris
errShare
errSave
Robust MPC with recursive model update
err2019-05-01
err130
errOAAI
errLorenzen, Matthias; Cannon, Mark; Allgoewer, Frank
errShare
errSave
A Computationally Efficient Robust Model Predictive Control Framework for Uncertain Nonlinear Systems
err2021-02-01
err133
errOAAI
errKoehler, Johannes; Soloperto, Raffaele; Mueller, Matthias A.; Allgoewer, Frank
errShare
errSave
Dual robust nonlinear model predictive control: A multi-stage approach
err2018-12-01
err35
errOAAI
errThangavel, S.; Lucia, S.; Paulen, R.; Engell, S.
errShare
errSave
Robust economic Model Predictive Control using stochastic information
err2016-12-01
err37
PREAI
errBayer, Florian A.; Lorenzen, Matthias; Mueller, Matthias A.; Allgoewer, Frank
errShare
errSave
errShare
errSave
errShare
errSave
Stabilization of strictly dissipative discrete time systems with discounted optimal control
err2018-07-01
err23
errOAAI
errGaitsgory, Vladimir; Gruene, Lars; Hoeger, Matthias; Kellett, Christopher M.; Weller, Steven R.
errShare
errSave
researcher View more