arrow
返回

Safe exploration in model-based reinforcement learning using control barrier functions

delete2023-01-01
delete18
delete
OA
AI
M
M. Cohen *
C
Călin Belta
DOI:10.1016/j.automatica.2022.110684delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs). Our approach is facilitated by the development of a novel class of CBFs, termed Lyapunov-like CBFs (LCBFs), that retain the beneficial properties of CBFs for developing minimally-invasive safe control policies while also possessing desirable Lyapunov-like qualities such as positive semi-definiteness. We show how these LCBFs can be used to augment a learning-based control policy to guarantee safety and then leverage this approach to develop a safe exploration framework in a MBRL setting. We demonstrate that our approach can handle more general safety constraints than comparative methods via numerical examples.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Adaptive control
Control barrier functions
Reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

B
boston university
学者数:
3.8W
论文数: 3.2W
被引数: 67
引用论文

引用论文

Formation and properties of radiation-induced defects and radiolysis products in lithium orthosilicate
err1991-12-01
err0
PREAI
errJ.E. Tiliks; G.K. Kizane; A.A. Supe; A.A. Abramenkovs; J.J. Tiliks; V.G. Vasiljev
err分享
err收藏
Data-based reinforcement learning approximate optimal control for an uncertain nonlinear system with control effectiveness faults
err2020-06-01
err26
errOAAI
errDeptula, Patryk; Bell, Zachary, I; Doucette, Emily A.; Curtis, J. Willard; Dixon, Warren E.
err分享
err收藏
err分享
err收藏
Approximate optimal influence over an agent through an uncertain interaction dynamic
err2021-12-01
err6
errOAAI
errDeptula, Patryk; Bell, Zachary I.; Zegers, Federico M.; Licitra, Ryan A.; Dixon, Warren E.
err分享
err收藏
err分享
err收藏
The State Following Approximation Method
err2019-06-01
err12
errOAAI
errRosenfeld, Joel A.; Kamalapurkar, Rushikesh; Dixon, Warren E.
err分享
err收藏
Safe reinforcement learning for dynamical games
err2020-03-25
err80
PREAI
errYang, Yongliang; Vamvoudakis, Kyriakos G.; Modares, Hamidreza
err分享
err收藏
err分享
err收藏
学者 查看更多内容