返回
Sparse Bayesian deep learning for dynamic system identification
DOI:10.1016/j.automatica.2022.110489.png)
摘要
En 中文
This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system iden-tification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification problems. First, DNNs are known to be too complex that they can easily overfit the training data. Second, the selection of the input regressors for system identification is nontrivial. Third, uncertainty quantification of the model parameters and predictions are necessary. The proposed Bayesian approach offers a principled way to alleviate the above challenges by marginal likelihood/model evidence approximation and structured group sparsity-inducing priors construction. The identification algorithm is derived as an iterative regularised optimisation procedure that can be solved as efficiently as training typical DNNs. Remarkably, an efficient and recursive Hessian calculation method for each layer of DNNs is developed, turning the intractable training/optimisation process into a tractable one. Furthermore, a practical calculation approach based on the Monte-Carlo integration method is derived to quantify the uncertainty of the parameters and predictions. The effectiveness of the proposed Bayesian approach is demonstrated on several linear and nonlinear system identification benchmarks by achieving good and competitive simulation accuracy. The code to reproduce the experimental results is open-sourced and available online. (C) 2022 Published by Elsevier Ltd.
Keyword:
Regularised system identification
Deep neural networks
Group sparsity
Sparse Bayesian learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
1.2W
被引数:
6.5W
机构
引用论文
Arsenic Removal from Natural Water Using Low Cost Granulated Adsorbents: A Review使用低成本颗粒状吸附剂从天然水中去除砷: 综述
Cross-linkable Polymer Matrix for Enhanced Thermal Stability of Succinonitrile-based Polymer Electrolyte in Lithium Rechargeable Batteries可交联聚合物基质,用于增强锂可充电电池中基于丁二腈的聚合物电解质的热稳定性
Regularized LTI system identification in the presence of outliers: A variational EM approach
AUTOMATICA
IF5.9

