arrow
Return

SMEM: A Subspace Merging Based Evolutionary Method for High-Dimensional Feature Selection

delete2024-01-01
delete0
PRE
AI
K
Kaixuan Li
S
Shibo Jiang
R
Rui Zhang
邱剑锋 (Jianfeng Qiu)
张磊 (Lei Zhang)
L
Lixia Yang
程凡 (Fan Cheng) *
DOI:10.1109/TETCI.2024.3451695delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the past decade, evolutionary algorithms (EAs) have shown their promising performance in solving the problem of feature selection. Despite that, it is still quite challenging to design the EAs for high-dimensional feature selection (HDFS), since the increasing number of features causes the search space of EAs grows exponentially, which is known as the curse of dimensionality. To tackle the issue, in this paper, a Subspace Merging based Evolutionary Method, termed SMEM is suggested. In SMEM, to avoid directly optimizing the large search space of HDFS, the original feature space of HDFS is firstly divided into several independent low-dimensional subspaces. In each subspace, a subpopulation is evolved to obtain the latent good feature subsets quickly. Then, to avoid some features being missed, these low-dimensional subspaces merge in pairs, and the further search is carried on the merged subspaces. During the evolving of each merged subspace, the good feature subsets obtained from previous subspace pair are fully utilized. The above subspace merging procedure repeats, and the performance of SMEM is improved gradually, until in the end, all the subspaces are merged into one final space. At that time, the final space is also the original feature space in HDFS, which ensures all the features in the data is considered. Experimental results on different high-dimensional datasets demonstrate the effectiveness and the efficiency of the proposed SMEM, when compared with the state-of-the-arts.
Keywords:
Feature extraction
Search problems
Merging
Optimization
Sorting
History
Fans
High-dimensional feature selection
multi-objective evolutionary optimization
subspace division
pairwise subspace merging

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24