.png){kind=icon}
.png){kind=icon}
Return
DHR-BLS: A Huber-type robust broad learning system with its distributed version
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2025.113184.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The broad learning system (BLS) is a recently developed neural network framework recognized for its efficiency and effectiveness in handling high-dimensional data with a flat network architecture. However, traditional BLS models are highly sensitive to outliers and noisy data, which can significantly degrade performance. While incorporating the 81-norm loss function enhances robustness against outliers, it often compromises performance on clean datasets. To address this limitation, we propose the Huber-type robust broad learning system (HR- BLS), which integrates the Huber loss function into BLS, effectively combining the strengths of both 81-norm and 82-norm loss functions to achieve balanced robustness against data anomalies. Moreover, the elastic- net regularization is included to simultaneously enhance model stability and promote sparsity. To effectively manage large-scale and distributed data, we extend HR-BLS by introducing the distributed Huber-type robust broad learning system (DHR-BLS). Given the non-differentiability of the 81-norm, traditional gradient-based optimization methods are insufficient. Therefore, we adopt the alternating direction method of multipliers (ADMM) to train, ensuring convergence through the use of appropriate constraints. Experimental results on both synthetic and benchmark datasets show that HR-BLS outperforms traditional BLS and other state-of-the-art robust learning methods in terms of accuracy and robustness. Furthermore, DHR-BLS demonstrates exceptional scalability and effectiveness, making it suitable for distributed learning environments.
Keywords:
Alternating direction method of multipliers
Broad learning system
Distributed learning
Huber loss function
Outliers