arrow
Return

Online Stochastic Optimization for Unknown Linear Systems: Data-Driven Controller Synthesis and Analysis

delete2024-07-01
delete2
PRE
AI
G
Gianluca Bianchin *
M
Miguel Vaquero
J
Jorge Cortés
E
Emiliano Dall’Anese
DOI:10.1109/TAC.2023.3323581delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article proposes a data-driven control framework to regulate an unknown stochastic linear dynamical system to the solution of a stochastic convex optimization problem. Despite the centrality of this problem, most of the available methods critically rely on a precise knowledge of the system dynamics, thus requiring offline system identification. To solve the control problem, we first show that the steady-state gain of the transfer function of a linear system can be computed directly from historical data generated by the open-loop system, thus overcoming the need to first identify the full system dynamics. We leverage this data-driven representation of the steady-state gain to design a controller, which is inspired by stochastic gradient descent methods, to regulate the system to the solution of the prescribed optimization problem. A distinguishing feature of our method is that it does not require any knowledge of the system dynamics or of the possibly time-varying disturbances affecting them (or their distributions). Our technical analysis combines concepts from behavioral system theory, stochastic optimization with decision-dependent distributions, and Lyapunov stability. We illustrate the applicability of the framework in a case study for mobility-on-demand ride service scheduling in Manhattan.
Keywords:
Optimization
Stochastic processes
Control systems
Trajectory
Steady-state
Power system dynamics
Linear systems
Control design
data-driven control
learning systems
optimization methods
stochastic optimization
shared transport

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

University of Colorado System cover
University of Colorado System
Scholars:
6.3W
Papers: 5.5W
Citations: 1.8K
IE University cover
IE University
Scholars:
397
Papers: 595
Citations: 1.3K
U
university of colorado boulder
Scholars:
1.9W
Papers: 1.5W
Citations: 33
U
University of California San Diego
Scholars:
4.6W
Papers: 3.5W
Citations: 924
researcher View more organizations