arrow
Return

Sequential Learning and Control: Targeted Exploration for Robust Performance

delete2025-01-01
delete0
delete
OA
AI
J
Janani Venkatasubramanian *
J
Johannes Köhler
J
Julian Berberich
F
Frank Allgöwer
DOI:10.1109/TAC.2024.3430088delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, we present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented after exploration with the main feature that the exploration is optimized with respect to the robust control performance. Specifically, we leverage recent results on finite excitation using spectral lines to determine a high-probability lower bound on the resultant finite excitation of the exploration data. This provides an a priori upper bound on the remaining model uncertainty after exploration, which can further be leveraged in a gain-scheduling controller design that guarantees robust performance. This leads to a semidefinite program-based design which computes an exploration strategy with finite excitation bounds and minimal energy, and a gain-scheduled controller with probabilistic performance bounds that can be implemented after exploration. The effectiveness of our approach and its benefits over common random exploration strategies are demonstrated with an example of a system which is hard to learn.
Keywords:
Uncertainty
Covariance matrices
Vectors
Closed loop systems
Random variables
Dual control
identification for control
robust control
uncertain systems
robust control
uncertain systems

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

U
University of Stuttgart
Scholars:
1.1W
Papers: 9.4K
Citations: 1.3W
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163