Broad Learning System Based on Maximum Correntropy Criterion

doi:10.1109/TNNLS.2020.3009417

Broad Learning System Based on Maximum Correntropy Criterion

2021-07-01

63

OA

AI

DOI：10.1109/TNNLS.2020.3009417

Original

Save

View PDF

Abstract

En 中文

As an effective and efficient discriminative learning method, broad learning system (BLS) has received increasing attention due to its outstanding performance in various regression and classification problems. However, the standard BLS is derived under the minimum mean square error (MMSE) criterion, which is, of course, not always a good choice due to its sensitivity to outliers. To enhance the robustness of BLS, we propose in this work to adopt the maximum correntropy criterion (MCC) to train the output weights, obtaining a correntropy-based BLS (C-BLS). Due to the inherent superiorities of MCC, the proposed C-BLS is expected to achieve excellent robustness to outliers while maintaining the original performance of the standard BLS in the Gaussian or noise-free environment. In addition, three alternative incremental learning algorithms, derived from a weighted regularized least-squares solution rather than pseudoinverse formula, for C-BLS are developed. With the incremental learning algorithms, the system can be updated quickly without the entire retraining process from the beginning when some new samples arrive or the network deems to be expanded. Experiments on various regression and classification data sets are reported to demonstrate the desirable performance of the new methods.

Keywords:

Learning systems

Robustness

Standards

Optimization

Training

Perturbation methods

Mean square error methods

Broad learning system (BLS)

incremental learning algorithms

maximum correntropy criterion (MCC)

regression and classification

Broad Learning System Based on Maximum Correntropy Criterion

Abstract

AI Summary

Journal

Organization