arrow
返回

Actively learning dynamical systems using Bayesian neural networks

delete2023-10-27
delete0
PRE
AI
S
Shengbing Tang *
K
Kenji Fujimoto
I
Ichiro Maruta
DOI:10.1007/s10489-023-05044-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Learning dynamical systems in a sample-efficient way is important for model-based control. Active learning which sequentially selects the most informative data to sample is capable of greatly reducing sample complexity. The active learning problem for dynamical systems is hard as we can not arbitrarily draw samples from the system's state space under constraints of system dynamics. The existing approaches model the dynamical systems using Bayesian linear regression or Gaussian processes which can not be applied to complex dynamical systems with high-dimensional state spaces. In this article, we propose a new method to actively learn dynamical systems using Bayesian neural networks which allow for modeling high-dimensional systems with complex dynamics. By maximizing the accumulated differential entropies along the trajectory, the proposed method iteratively searches for the most informative action sequence which will yield informative samples when applied to the real system. With random exploration and model-based reinforcement learning as baselines, we verify the superiority of the proposed method via accuracy of one-step and multi-step predictions, the control performance, the exploration efficiency of the state space on numerical benchmarks.
Keyword:
Active learning
Dynamical system
Bayesian neural network
Model predictive control

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

K
Kyoto University
学者数:
5.1W
论文数: 4.6W
被引数: 6.1W
C
Central China Normal University
学者数:
1.1W
论文数: 8.1K
被引数: 1.1W
引用论文

引用论文

Actively Learning Gaussian Process Dynamical Systems Through Global and Local Explorations
err2022-01-01
err1
errOAAI
errTang, Shengbing; Fujimoto, Kenji; Maruta, Ichiro
err分享
err收藏
NON-SEASONALITY OF SICKLE-CELL CRISIS
err1973-09-01
err0
PREAI
errRuthAndrea Seeler
err分享
err收藏
Model-based Reinforcement Learning: A Survey基于模型的强化学习: 综述
err2023-01-01
err161
errOAAI
errMoerland, Thomas M.; Broekens, Joost; Plaat, Aske; Jonker, Catholijn M.
err分享
err收藏
Hands-On Bayesian Neural Networks-A Tutorial for Deep Learning Users
err2022-05-01
err296
errOAAI
errJospin, Laurent Valentin; Laga, Hamid; Boussaid, Farid; Buntine, Wray; Bennamoun, Mohammed
err分享
err收藏
A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials
err2020-04-01
err84
errOAAI
errChatzilygeroudis, Konstantinos; Vassiliades, Vassilis; Stulp, Freek; Calinon, Sylvain; Mouret, Jean-Baptiste
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容