arrow
返回

Adaptive Control and Intersections with Reinforcement Learning

delete2023-05-03
delete13
delete
OA
AI
A
Anuradha M. Annaswamy *
DOI:10.1146/annurev-control-062922-090153delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This article provides an exposition of the field of adaptive control and its intersections with reinforcement learning. Adaptive control and reinforcement learning are two different methods that are both commonly employed for the control of uncertain systems. Historically, adaptive control has excelled at real-time control of systems with specific model structures through adaptive rules that learn the underlying parameters while providing strict guarantees on stability, asymptotic performance, and learning. Reinforcement learning methods are applicable to a broad class of systems and are able to produce near-optimal policies for highly complex control tasks. This is often enabled by significant offline training via simulation or the collection of large input-state datasets. This article attempts to compare adaptive control and reinforcement learning using a common framework. The problem statement in each field and highlights of their results are outlined. Two specific examples of dynamic systems are used to illustrate the details of the two methods, their advantages, and their deficiencies. The need for real-time control methods that leverage tools from both approaches is motivated through the lens of this common framework.
Keyword:
adaptive control
reinforcement learning
adaptation
optimality
stability
robustness

期刊

A
Annual Review of Control Robotics and Autonomous Systems
IF:
14
论文数:
98
被引数:
2.3K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Phenotypical and Functional Characterization of Bone Marrow Mesenchymal Stem Cells in Patients with Chronic Graft-versus-Host Disease
err2015-06-01
err0
errOAAI
errBinsheng Wang; Yongxian Hu; Lizhen Liu; Kaimin Hu; Ruxiu Tie; Ying He; Shan Fu; Ni Zhu; Yi Luo; Xiaohong Yu; He Huang
err分享
err收藏
Estrogens Counteract Platinum-Chemosensitivity by Modifying the Subcellular Localization of MDM4
err2019-09-12
err0
errOAAI
errRossella Lucà; Giorgia di Blasio; Daniela Gallo; Valentina Monteleone; Isabella Manni; Laura Fici; Marianna Buttarelli; Germana Ciolli; Marsha Pellegrino; Emanuela Teveroni; Silvia Maiullari; Alessandra Ciucci; Alessandro Apollo; Francesca Mancini; Maria Pia Gentileschi; Gian Franco Zannoni; Alfredo Pontecorvi; Giovanni Scambia; Fabiola Moretti
err分享
err收藏
err分享
err收藏
学者 查看更多内容