arrow
Return

Sparse Bayesian deep learning for dynamic system identification

delete2022-10-01
delete12
delete
OA
AI
H
Hongpeng Zhou
C
Chahine Ibrahim
Wei Xing Zheng cover
Wei Xing Zheng (Wei Xing Zheng)
W
Wei Pan *
DOI:10.1016/j.automatica.2022.110489delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system iden-tification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification problems. First, DNNs are known to be too complex that they can easily overfit the training data. Second, the selection of the input regressors for system identification is nontrivial. Third, uncertainty quantification of the model parameters and predictions are necessary. The proposed Bayesian approach offers a principled way to alleviate the above challenges by marginal likelihood/model evidence approximation and structured group sparsity-inducing priors construction. The identification algorithm is derived as an iterative regularised optimisation procedure that can be solved as efficiently as training typical DNNs. Remarkably, an efficient and recursive Hessian calculation method for each layer of DNNs is developed, turning the intractable training/optimisation process into a tractable one. Furthermore, a practical calculation approach based on the Monte-Carlo integration method is derived to quantify the uncertainty of the parameters and predictions. The effectiveness of the proposed Bayesian approach is demonstrated on several linear and nonlinear system identification benchmarks by achieving good and competitive simulation accuracy. The code to reproduce the experimental results is open-sourced and available online. (C) 2022 Published by Elsevier Ltd.
Keywords:
Regularised system identification
Deep neural networks
Group sparsity
Sparse Bayesian learning

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
6.5W

Organization

D
delft university of technology
Scholars:
2.0K
Papers: 825
Citations: 2.3W
W
Western Sydney University
Scholars:
661
Papers: 317
Citations: 8.2K
Cited Papers

Cited Papers

Arsenic Removal from Natural Water Using Low Cost Granulated Adsorbents: A Review
err2014-05-30
err0
errOAAI
errShams Ali Baig; Tiantian Sheng; Yunjun Hu; Jiang Xu; Xinhua Xu
errShare
errSave
errShare
errSave
errShare
errSave
Cross-linkable Polymer Matrix for Enhanced Thermal Stability of Succinonitrile-based Polymer Electrolyte in Lithium Rechargeable Batteries
err2011-12-31
err0
errOAAI
errMyung-Hyun Ryou; Dong-Jin Lee; Je-Nam Lee; Hong-Kyeong Lee; Myung-Won Seo; Hye-Won Lee; Weon-Ho Shin; Yong-Min Lee; Jang-Wook Choi; Jung-Ki Park
errShare
errSave
Variable selection using neural-network models
err2000-03-01
err113
PREAI
errCastellano, G; Fanelli, AM
errShare
errSave
errShare
errSave
researcher View more