返回
Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behavior
DOI:10.1016/j.automatica.2024.111642.png)
摘要
En 中文
We propose a framework for the design of feedback controllers that combines the optimization -driven and model -free advantages of deep reinforcement learning with the stability guarantees provided by using the Youla-Ku & ccaron;era parameterization to define the search domain. Recent advances in behavioral systems allow us to construct a data -driven internal model; this enables an alternative realization of the Youla-Ku & ccaron;era parameterization based entirely on input-output exploration data. Perhaps of independent interest, we formulate and analyze the stability of such data -driven models in the presence of noise. The Youla-Ku & ccaron;era approach requires a stable parameterfor controller design. For the training of reinforcement learning agents, the set of all stable linear operators is given explicitly through a matrix factorization approach. Moreover, a nonlinear extension is given using a neural network to express a parameterized set of stable operators, which enables seamless integration with standard deep learning libraries. Finally, we show how these ideas can also be applied to tune fixed -structure controllers (c) 2024 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Keyword:
Reinforcement learning
Data -driven control
Youla-Ku & ccaron
era parameterization
Neural networks
Stability
Process control
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
1.2W
被引数:
5.2W
机构
引用论文
Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems
AUTOMATICA
IF5.9
Deep reinforcement learning with shallow controllers: An experimental application to PID tuning基于浅层控制器的深度强化学习: PID整定的实验应用
Behavioral systems theory in data-driven analysis, signal processing, and control数据驱动分析,信号处理和控制中的行为系统理论

