返回
Self-Paced Broad Learning System
DOI:10.1109/TCYB.2022.3181449.png)
摘要
En 中文
Broad learning system (BLS), an efficient neural network with a flat structure, has received a lot of attention due to its advantages in training speed and network extensibility. However, the conventional BLS adopts the least square loss, which treats each sample equally and thus is sensitivity to noise and outliers. To address this concern, in this article we propose a self-paced BLS (SPBLS) model by incorporating the novel self-paced learning (SPL) strategy into the network for noisy data regression. With the assistance of the SPL criterion, the model output is used as feedback to learn appropriate priority weight to readjust the importance of each sample. Such a reweighting strategy can help SPBLS to distinguish samples from easy to difficult in model training, equipping the model robust to noise and outliers while maintaining the characteristics of the original system. Moreover, two incremental learning algorithms associated to SPBLS have also been developed, with which the system can be updated quickly and flexibly without retraining the entire model when new training samples are added or the network needs to be expanded. Experiments conducted on various datasets demonstrate that the proposed SPBLS can achieve satisfying performance for noisy data regression.
Keyword:
Training
Noise measurement
Data models
Feature extraction
Learning systems
Robustness
Manifold learning
Broad learning system (BLS)
importance reweighting strategy
noisy data regression
self-paced learning (SPL)
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Adaptive Deep Cascade Broad Learning System and Its Application in Image Denoising自适应深度级联广义学习系统及其在图像去噪中的应用
Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images自定进度联合稀疏表示在高光谱图像分类中的应用
GCB-Net: Graph Convolutional Broad Network and Its Application in Emotion RecognitionGcb-net: 图卷积广义网络及其在情感识别中的应用

