arrow
返回

Discretization-Based Feature Selection as a Bilevel Optimization Problem

delete2023-08-01
delete7
delete
OA
AI
R
Rihab Said *
M
Maha Elarbi
S
Slim Bechikh
C
Carlos A. Coello Coello
L
Lamjed Ben Saïd
DOI:10.1109/TEVC.2022.3192113delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Discretization-based feature selection (DBFS) approaches have shown interesting results when using several metaheuristic algorithms, such as particle swarm optimization (PSO), genetic algorithm (GA), ant colony optimization (ACO), etc. However, these methods share the same shortcoming which consists in encoding the problem solution as a sequence of cut-points. From this cut-points vector, the decision of deleting or selecting any feature is induced. Indeed, the number of generated cut-points varies from one feature to another. Thus, the higher the number of cut-points, the higher the probability of selecting the considered feature; and vice versa. This fact leads to the deletion of possibly important features having a single or a low number of cut-points, such as the infection rate, the glycemia level, and the blood pressure. In order to solve the issue of the dependency relation between the feature selection (or removal) event and the number of its generated potential cut-points, we propose to model the DBFS task as a bilevel optimization problem and then solve it using an improved version of an existing co-evolutionary algorithm, named I-CEMBA. The latter ensures the variation of the number of features during the migration process in order to deal with the multimodality aspect. The resulting algorithm, termed bilevel discretization-based feature selection (Bi-DFS), performs selection at the upper level while discretization is done at the lower level. The experimental results on several high-dimensional datasets show that Bi-DFS outperforms relevant state-of-the-art methods in terms of classification accuracy, generalization ability, and feature selection bias.
Keyword:
Bilevel optimization
co-evolutionary algorithm
cut-points search
discretization-based feature selection (DBFS)
features interactions

期刊

IEEE Transactions on Evolutionary Computation 封面图
IEEE Transactions on Evolutionary Computation
IF:
12
论文数:
1.9K
被引数:
2.4W

机构

U
universite de tunis
学者数:
1.1K
论文数: 987
被引数: 1
引用论文

引用论文

Solving Combinatorial Multi-Objective Bi-Level Optimization Problems Using Multiple Populations and Migration Schemes
err2020-01-01
err23
PREAI
errSaid, Rihab; Bechikh, Slim; Louati, Ali; Aldaej, Abdulaziz; Said, Lamjed Ben
err分享
err收藏
Evolutionary induction of a decision tree for large-scale data: a GPU-based approach
err2016-08-22
err27
PREAI
errJurczuk, Krzysztof; Czajkowski, Marcin; Kretowski, Marek
err分享
err收藏
学者 查看更多内容