arrow
返回

SAMBA: safe model-based & active reinforcement learning

delete2022-01-04
delete5
delete
OA
AI
A
Alexander I. Cowen-Rivers *
D
Daniel Palenicek
V
Vincent Moens
M
Mohammed Amin Abdullah
A
Aivar Sootla
王娟 封面图
王娟 (Jun Wang)
H
Haitham Bou Ammar
DOI:10.1007/s10994-021-06103-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose SAMBA, a novel framework for safe reinforcement learning that combines aspects from probabilistic modelling, information theory, and statistics. Our method builds upon PILCO to enable active exploration using novel acquisition functions for out-of-sample Gaussian process evaluation optimised through a multi-objective problem that supports conditional-value-at-risk constraints. We evaluate our algorithm on a variety of safe dynamical system benchmarks involving both low and high-dimensional state representations. Our results show orders of magnitude reductions in samples and violations compared to state-of-the-art methods. Lastly, we provide intuition as to the effectiveness of the framework by a detailed analysis of our acquisition functions and safety constraints.
Keyword:
Gaussian process
Safe reinforcement learning
Active learning

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

T
Technical University of Darmstadt
学者数:
1.3W
论文数: 10.0K
被引数: 1.2W
引用论文

引用论文

Optimization of conditional value-at-risk条件风险价值的优化
err2000-01-01
err0
PREAI
errR. Tyrrell Rockafellar; Stanislav Uryasev
err分享
err收藏
Deep Brain Stimulation Effects in Patients with Tinnitus
err2009-08-01
err0
PREAI
errYongbing Shi; Kim J. Burchiel; Valerie C. Anderson; William Hal Martin
err分享
err收藏
Mechanical Performances of Fly Ash Geopolymer Bricks
err2013-01-01
err0
PREAI
errW. I. Wan Mastura; H. Kamarudin; I. Khairul Nizar; A. M. Mustafa Al Bakril
err分享
err收藏
The Role of Multiple Large Shareholders in the Choice of Debt Source
err2016-11-04
err0
PREAI
errSabri Boubaker; Wael Rouatbi; Walid Saffar
err分享
err收藏
MOGPTK: The multi-output Gaussian process toolkit
err2021-02-01
err29
errOAAI
errde Wolff, Taco; Cuevas, Alejandro; Tobar, Felipe
err分享
err收藏
学者 查看更多内容