arrow
返回

An Effective Online Sequential Stochastic Configuration Algorithm for Neural Networks

delete2022-11-23
delete1
delete
OA
AI
Y
Yuting Chen
M
Ming Li *
DOI:10.3390/su142315601delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Random Vector Functional-link (RVFL) networks, as a class of random learner models, have received careful attention from the neural network research community due to their advantages in obtaining fast learning algorithms and models, in which the hidden layer parameters are randomly generated and remain fixed during the training phase. However, its universal approximation ability may not be guaranteed if the random parameters are not properly selected in an appropriate range. Moreover, the resulting random learner's generalization performance may seriously deteriorate once the RVFL network's structure is not well-designed. Stochastic configuration (SC) algorithm, which incrementally constructs a universal approximator by obtaining random hidden parameters under a specified supervisory mechanism, instead of fixing the selection scope in advance and without any reference to training information, can effectively circumvent these awkward issues caused by randomness. This paper extends the SC algorithm to an online sequential version, termed as an OSSC algorithm, by means of recursive least square (RLS) technique, aiming to copy with modeling tasks where training observations are sequentially provided. Compared to the online sequential learning of RVFL networks (OS-RVFL in short), our proposed OSSC algorithm can avoid the awkward setting of certain unreasonable range for the random parameters, and can also successfully build a random learner with preferable learning and generalization capabilities. The experimental study has shown the effectiveness and advantages of our OSSC algorithm.
Keyword:
stochastic configuration algorithm
random vector functional-link (RVFL) networks
online sequential learning
neural networks with random weights

期刊

Sustainability 封面图
Sustainability
IF:
3.3
论文数:
10.7W
被引数:
28.4W

机构

Z
Zhejiang Normal University
学者数:
1.3W
论文数: 8.4K
被引数: 1.2W
引用论文

引用论文

Fast Haar Transforms for Graph Neural Networks
err2020-08-01
err59
errOAAI
errLi, Ming; Ma, Zheng; Wang, Yu Guang; Zhuang, Xiaosheng
err分享
err收藏
Relationship between trait anxiety, prefrontal cortex, and attention bias to angry faces in children and adolescents
err2008-10-01
err0
errOAAI
errEva H. Telzer; Karin Mogg; Brendan P. Bradley; Xiaoqin Mai; Monique Ernst; Daniel S. Pine; Christopher S. Monk
err分享
err收藏
err分享
err收藏
学者 查看更多内容