arrow
Return

AdaBoost-Stacking Based on Incremental Broad Learning System

delete2024-12-01
delete0
PRE
AI
Y
Yun Fan
Z
Zhiwen Yu *
K
Kaixiang Yang
陈晨 cover
陈晨 (C. L. Philip Chen)
DOI:10.1109/TKDE.2024.3433587delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to the advantages of fast training speed and competitive performance, Broad Learning System (BLS) has been widely used for classification tasks across various domains. However, the random weight generation mechanism in BLS makes the model unstable, and the performance of BLS may be limited when dealing with some complex datasets. On the other hand, the instability of BLS brings diversity to ensemble learning, and ensemble methods can also reduce the variance and bias of the single BLS. Therefore, we propose an ensemble learning algorithm based on BLS, which includes three modules. To improve the stability and generalization ability of BLS, we utilize BLS as the base classifier in an AdaBoost framework first. Taking advantage of the incremental learning mechanism of BLS, we then propose a selective ensemble method to raise the accuracy and diversity of the BLS ensemble method. In addition, based on the former selective Adaboost framework, we suggest a hierarchical ensemble algorithm, which combines sample and feature dimensions to further improve the fitting ability of the ensemble BLS. Extensive experiments have demonstrated that the proposed method performs better than the original BLS and other state-of-the-art models, proving the effectiveness and versatility of our proposed approaches.
Keywords:
ensemble learning
incremental learning
Broad learning system
AdaBoost
AdaBoost
stacking
stacking
AdaBoost
stacking

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Hybrid Classifier Ensemble for Imbalanced Data
err2020-04-01
err87
PREAI
errYang, Kaixiang; Yu, Zhiwen; Wen, Xin; Cao, Wenming; Chen, C. L. Philip; Wong, Hau-San; You, Jane
errShare
errSave
A survey on imbalanced learning: latest research, applications and future directions
err2024-05-09
err22
errOAAI
errChen, Wuxing; Yang, Kaixiang; Yu, Zhiwen; Shi, Yifan; Chen, C. L. Philip
errShare
errSave
Solving the Imbalanced Problem by Metric Learning and Oversampling
err2024-12-01
err4
PREAI
errYang, Kaixiang; Yu, Zhiwen; Chen, Wuxing; Liang, Zefeng; Chen, C. L. Philip
errShare
errSave
Regularized robust Broad Learning System for uncertain data modeling
err2018-12-01
err111
PREAI
errJin, Jun-Wei; Chen, C. L. Philip
errShare
errSave
Progressive subspace ensemble learning
err2016-12-01
err43
PREAI
errYu, Zhiwen; Wang, Daxing; You, Jane; Wong, Hau-San; Wu, Si; Zhang, Jun; Han, Guoqiang
errShare
errSave
errShare
errSave
researcher View more