arrow
返回

Bayesian Random Vector Functional-Link Networks for Robust Data Modeling

delete2018-07-01
delete26
PRE
AI
S
Simone Scardapane *
王殿辉 封面图
王殿辉 (Dianhui Wang)
A
Aurelio Uncini
DOI:10.1109/TCYB.2017.2726143delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Random vector functional-link (RVFL) networks are randomized multilayer perceptrons with a single hidden layer and a linear output layer, which can be trained by solving a linear modeling problem. In particular, they are generally trained using a closed-form solution of the (regularized) least-squares approach. This paper introduces several alternative strategies for performing full Bayesian inference (BI) of RVFL networks. Distinct from standard or classical approaches, our proposed Bayesian training algorithms allow to derive an entire probability distribution over the optimal output weights of the network, instead of a single pointwise estimate according to some given criterion (e.g., least-squares). This provides several known advantages, including the possibility of introducing additional prior knowledge in the training process, the availability of an uncertainty measure during the test phase, and the capability of automatically inferring hyper-parameters from given data. In this paper, two BI algorithms for regression are first proposed that, under some practical assumptions, can be implemented by a simple iterative process with closed-form computations. Simulation results show that one of the proposed algorithms, Bayesian RVFL, is able to outperform standard training algorithms for RVFL networks with a proper regularization factor selected carefully via a line search procedure. A general strategy based on variational inference is also presented, with an application to data modeling problems with noisy outputs or outliers. As we discuss in this paper, using recent advances in automatic differentiation this strategy can be applied to a wide range of additional situations in an immediate fashion.
Keyword:
Bayesian inference (BI)
random vector functional-link (RVFL)
relevance vector machine (RVM)
variational inference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

L
La Trobe University
学者数:
1.1W
论文数: 1.1W
被引数: 1.5W
S
sapienza university rome
学者数:
6.3W
论文数: 4.7W
被引数: 381
引用论文

引用论文

Flight mask designs of the Roman Space Telescope coronagraph instrument
err2021-09-01
err0
errOAAI
errA.J. Eldorado Riggs; Vanessa Bailey; Dwight C. Moody; Erkin Sidick; Kunjithapatham Balasubramanian; Douglas M. Moore; Daniel W. Wilson; Garreth Ruane; Dan Sirbu; Jessica Gersh-Range; John Trauger; Bertrand Mennesson; Nicholas Siegler; Eduardo Bendek; Tyler D. Groff; Neil T. Zimmerman; John Debes; Scott A. Basinger; N. Jeremy Kasdin
err分享
err收藏
Imine-linked micron-network polymers with high polyethylene glycol uptake for shaped-stabilized phase change materials
err2016-01-01
err0
PREAI
errJia Tang; Shuang Fan; Wenjun Dong; Jingjing Wang; Hongyi Gao; Mu Yang; Ming Yang; Ge Wang
err分享
err收藏
Implementation of a multidisciplinary treatment team for hepatocellular cancer at a Veterans Affairs Medical Center improves survival
errHPB
IF0
err2008-12-01
err0
errOAAI
errTammy T. Chang; Rajiv Sawhney; Alexander Monto; J. Ben Davoren; Jacob G. Kirkland; Lygia Stewart; Carlos U. Corvera
err分享
err收藏
学者 查看更多内容