A Novel Classifier Ensemble Method Based on Subspace Enhancement for High-Dimensional Data Classification

doi:10.1109/TKDE.2021.3087517

2023-01-01

PRE

Yuhong Xu

Zhiwen Yu *

Wenming Cao

陈晨 (C. L. Philip Chen)

DOI：10.1109/TKDE.2021.3087517

原文链接

原文求助

摘要

En 中文

High-dimensional small-size data seriously affects the performance of classifiers. By combining classifiers, ensemble learning obtains higher accuracy and more robust predictions. However, these classifier ensemble methods suffer from several limitations: 1) ensemble with sample space suffers from noise and redundant features; 2) constructing sample subspace on small-size data leads to an insufficient description of sample space; 3) ensemble with random feature subspace leads to information loss, which will degrade the performance of classifiers; 4) most ensemble methods implement directly on the original feature space, which is defective in high-dimensional data with redundant and noisy features. To overcome the above limitations, a new classifier ensemble method based on subspace enhancement (CESE) is proposed for high-dimensional data classification. First, a superior subspace enhancement scheme (SSE) is designed to effectively implement feature selection and transformation for high-dimensional data, followed by generating multiple superior feature subspaces with diversity and discrimination, which enhances the representative ability of features. Second, we develop a mixed space enhancement process (MSE) based on multiscale rotation reconstruction and various subspace enhanced features of SSE. By using MSE, an effective feature fusion is constructed to obtain more diverse features. Furthermore, to improve the capability of our method, we design various feature combination strategies for enhanced features from both SSE and MSE. Comparative results on 33 high-dimensional data sets indicate that our approach CESE outperforms different mainstream integrated systems.

Keyword:

Ensemble learning

feature transformation

subspace enhancement

high-dimensional data

classification