arrow
Return

Feature subset selection for big data via parallel chaotic binary differential evolution and feature-level elitism☆

delete2025-03-01
delete0
PRE
AI
Y
Yelleti Vivek
V
Vadlamani Ravi *
DOI:10.1016/j.compeleceng.2025.110232delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature subset selection (FSS) employing a wrapper approach is fundamentally a combinatorial optimization problem maximizing the area under the receiver operating characteristic curve (AUC) of a classifier built on this subset under single objective environment. To balance both the AUC and the cardinality of the selected feature subset, we propose a novel multiplicative fitness function that combines AUC and a decreasing function of cardinality. Although the differential evolution algorithm is robust, it is prone to premature convergence, which can result in entrapment in local optima. To address this challenge, we propose chaotic binary differential evolution coupled with feature-level elitism (CE-BDE), where the chaotic maps are introduced at the initialization and the crossover operator. We also introduce feature-level elitism to improve the exploitation capability. Feature-level elitism involves preserving those features, which are chosen based on their frequency of occurrence in the population in the evolution process. Dealing with big data entails computational complexity, which motivates us to propose an effective parallel/ distributed strategy island model. The results demonstrate that the parallel CE-BDE outperformed the rest of the algorithms in terms of mean AUC and cardinality. The speedup and computational gain yielded by the proposed parallel approach further accentuate its superiority. Overall, the topperforming algorithm with the multiplicative fitness function turned out to be statistically significant compared to that with the additive fitness function across 5 out of 6 datasets.
Keywords:
Feature subset selection
Spark
Evolutionary algorithms
Chaotic maps
Feature-level elitism

Journal

C
Computers and Electrical Engineering
IF:
4.9
Papers:
6.7K
Citations:
1.3W

Organization

N
national institute of technology (nit system)
Scholars:
4.0W
Papers: 3.7W
Citations: 31
N
National Institute of Technology Warangal
Scholars:
1.2K
Papers: 1.1K
Citations: 2.3K