arrow
Return

Tri-objective optimization-based cascade ensemble pruning for deep forest

delete2023-11-01
delete3
PRE
AI
冀
冀俊忠 (Junzhong Ji) *
李
李军伟 (Junwei Li)
DOI:10.1016/j.patcog.2023.109744delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep forest is a new multi-layer ensemble model, where the high time costs and storage requirements inhibit its large-scale application. However, current deep forest pruning methods used to alleviate these drawbacks do not consider its cascade coupling characteristics. Therefore, we propose a tri-objective optimization-based cascade ensemble pruning (TOOCEP) algorithm for it. Concretely, we first present a tri-objective optimization-based single-layer pruning (TOOSLP) method to prune its single-layer by simultaneously optimizing three objectives, namely accuracy, independent diversity, and coupled diversity. Particularly, the coupled diversity is designed for deep forest to deal with the coupling relationships between its adjacent layers. Then, we perform TOOSLP in a cascade framework to prune the deep forest layer-by-layer. Experimental results on 15 UCI datasets show that TOOCEP outperforms several state-ofthe-art methods in accuracy and pruned rate, which significantly reduces the storage space and accelerate the prediction speed of deep forest. & COPY; 2023 Elsevier Ltd. All rights reserved.
Keywords:
Ensemble learning
Ensemble pruning
Deep forest
Multi-objective optimization
Coupled diversity

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
Cited Papers

Cited Papers

A spectral clustering based ensemble pruning approach
err2014-09-01
err45
PREAI
errZhang, Huaxiang; Cao, Linlin
errShare
errSave
errShare
errSave
An ensemble approach for supporting the respiratory isolation of presumed tuberculosis inpatients
err2019-02-01
err5
PREAI
errAlves, E. D. S.; Souza Filho, Joao B. O.; Kritski, A. L.
errShare
errSave
errShare
errSave
Stochastic ensemble pruning method via simulated quenching walking
err2019-01-02
err4
PREAI
errTaghavi, Zahra Sadat; Niaki, Seyed Taghi Akhavan; Niknamfar, Amir Hossein
errShare
errSave
Margin & diversity based ordering ensemble pruning
err2018-01-01
err72
PREAI
errGuo, Huaping; Liu, Hongbing; Li, Ran; Wu, Changan; Guo, Yibo; Xu, Mingliang
errShare
errSave
Improving deep forest by ensemble pruning based on feature vectorization and quantum walks
err2020-08-29
err8
PREAI
errGao, Jie; Liu, Kunhong; Wang, Beizhan; Wang, Dong; Zhang, Xiaoyan
errShare
errSave
researcher View more