arrow
Return

SAMBA: safe model-based & active reinforcement learning

delete2022-01-04
delete5
delete
OA
AI
A
Alexander I. Cowen-Rivers *
D
Daniel Palenicek
V
Vincent Moens
M
Mohammed Amin Abdullah
A
Aivar Sootla
王娟 cover
王娟 (Jun Wang)
H
Haitham Bou Ammar
DOI:10.1007/s10994-021-06103-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose SAMBA, a novel framework for safe reinforcement learning that combines aspects from probabilistic modelling, information theory, and statistics. Our method builds upon PILCO to enable active exploration using novel acquisition functions for out-of-sample Gaussian process evaluation optimised through a multi-objective problem that supports conditional-value-at-risk constraints. We evaluate our algorithm on a variety of safe dynamical system benchmarks involving both low and high-dimensional state representations. Our results show orders of magnitude reductions in samples and violations compared to state-of-the-art methods. Lastly, we provide intuition as to the effectiveness of the framework by a detailed analysis of our acquisition functions and safety constraints.
Keywords:
Gaussian process
Safe reinforcement learning
Active learning

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

T
Technical University of Darmstadt
Scholars:
1.3W
Papers: 10.0K
Citations: 1.2W