arrow
返回

Safety reinforcement learning control via transfer learning

delete2024-08-01
delete1
PRE
AI
Q
Quanqi Zhang
吴
吴承伟 (Chengwei Wu) *
H
Haoyu Tian
高
高亚斌 (Yabin Gao)
姚
姚蔚然 (Weiran Yao)
L
Ligang Wu
DOI:10.1016/j.automatica.2024.111714delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reinforcement learning (RL) has emerged as a promising approach for modern control systems. However, its success in real-world applications has been limited due to the lack of safety guarantees. To address this issue, the authors present a novel transfer learning framework that facilitates policy training in a non-dangerous environment, followed by transfer of the trained policy to the original dangerous environment. The transferred policy is theoretically proven to stabilize the original system while maintaining safety. Additionally, we propose an uncertainty learning algorithm incorporated in RL that overcomes natural data cascading and data evolution problems in RL to enhance learning accuracy. The transfer learning framework avoids trial-and-error in unsafe environments, ensuring not only after-learning safety but, more importantly, addressing the challenging problem of safe exploration during learning. Simulation results demonstrate the promise of the transfer learning framework for RL safety control on the task of vehicle lateral stability control with safety constraints. (c) 2024 Elsevier Ltd. All rights reserved.
Keyword:
Reinforcement learning control
Safety
Stability
Transfer learning

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

err分享
err收藏
A survey of transfer learning迁移学习研究综述
err2016-05-28
err0
errOAAI
errKarl Weiss; Taghi M. Khoshgoftaar; DingDing Wang
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
A General Safety Framework for Learning-Based Control in Uncertain Robotic Systems
err2019-07-01
err321
errOAAI
errFisac, Jaime F.; Akametalu, Anayo K.; Zeilinger, Melanie N.; Kaynama, Shahab; Gillula, Jeremy; Tomlin, Claire J.
err分享
err收藏
Gaseous bromine and particulate lead, vanadium, and bromine in a polluted atmosphere
err2002-05-01
err0
PREAI
errJarvis L. Moyers; William H. Zoller; Robert A. Duce; Gerald L. Hoffman
err分享
err收藏
学者 查看更多内容