arrow
Return

Control-Oriented Learning on the Fly

delete2020-11-01
delete8
delete
OA
AI
M
Melkior Ornik *
S
Steven Carr
A
Arie Israel
U
Ufuk Topcu
DOI:10.1109/TAC.2019.2963293delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This article focuses on developing a strategy for control of systems, whose dynamics are almost entirely unknown. This situation arises naturally in a scenario, where a system undergoes a critical failure. In that case, it is imperative to retain the ability to satisfy basic control objectives in order to avert an imminent catastrophe. To deal with limitations on the knowledge of system dynamics, we develop a theory of myopic control. At any given time, myopic control optimizes the current direction of the system trajectory, given solely the knowledge about system dynamics obtained from data until that time. We propose an algorithm that uses small perturbations in the control effort to learn system dynamics around the current system state, while ensuring that the system moves in a nearly optimal direction, and provide bounds for its suboptimality.
Keywords:
System dynamics
Trajectory
Optimal control
Aircraft
Approximation algorithms
Heuristic algorithms
Estimation
learning
optimal control
uncertain systems

Journal

IEEE Transactions on Automatic Control cover
IEEE Transactions on Automatic Control
IF:
7
Papers:
1.3W
Citations:
6.7W

Organization

U
University of Illinois Urbana-Champaign
Scholars:
2.4W
Papers: 2.0W
Citations: 35
University of Illinois System cover
University of Illinois System
Scholars:
6.9W
Papers: 6.2W
Citations: 644
Cited Papers

Cited Papers

Development of summary indices of antenatal care service quality in Haiti, Malawi and Tanzania
err2019-12-02
err0
errOAAI
errAshley Sheffel; Scott Zeger; Rebecca Heidkamp; Melinda Kay Munos
errShare
errSave
Isolation, chemical and functional characterization of several new K+-channel blocking peptides from the venom of the scorpion Centruroides tecomanus
err2016-06-01
err0
errOAAI
errTimoteo Olamendi-Portugal; Adam Bartok; Fernando Zamudio-Zuñiga; Andras Balajthy; Baltazar Becerril; Gyorgy Panyi; Lourival D. Possani
errShare
errSave
errShare
errSave
3-Trifluoromethyl-4-nitro-5-arylpyrazoles are novel KATP channel agonists
err2004-02-01
err0
PREAI
errAndrew J. Peat; Claire Townsend; M. Craig McKay; Dulce Garrido; Christopher M. Terry; Jayme L.R. Wilson; Stephen A. Thomson
errShare
errSave
Liposomal Drug Delivery and Its Potential Impact on Cancer Research
err2022-09-01
err0
PREAI
errSankha Bhattacharya; Dnyanesh Saindane; Bhupendra G. Prajapati
errShare
errSave
researcher View more