arrow
Return

MEL: Efficient Multi-Task Evolutionary Learning for High-Dimensional Feature Selection

delete2024-08-01
delete3
delete
OA
AI
X
Xubin Wang
H
Haojiong Shangguan
F
Feng-Yi Huang
S
Shangrui Wu
W
Weijia Jia *
DOI:10.1109/TKDE.2024.3366333delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is a crucial step in data mining to enhance model performance by reducing data dimensionality. However, the increasing dimensionality of collected data exacerbates the challenge known as the curse of dimensionality, where computation grows exponentially with the number of dimensions. To tackle this issue, evolutionary computational (EC) approaches have gained popularity due to their simplicity and applicability. Unfortunately, the diverse designs of EC methods result in varying abilities to handle different data, often underutilizing and not sharing information effectively. In this article, we propose a novel approach called PSO-based Multi-task Evolutionary Learning (MEL) that leverages multi-task learning to address these challenges. By incorporating information sharing between different feature selection tasks, MEL achieves enhanced learning ability and efficiency. We evaluate the effectiveness of MEL through extensive experiments on 22 high-dimensional datasets. Comparing against 24 EC approaches, our method exhibits strong competitiveness. In addition, we have open-sourced our code on GitHub.
Keywords:
Feature extraction
Task analysis
Multitasking
Statistics
Sociology
Vectors
Particle swarm optimization
Feature selection
high-dimensional classification
knowledge transfer
multi-task learning
particle swarm optimization

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

H
Hong Kong Baptist University
Scholars:
6.3K
Papers: 7.5K
Citations: 1.3W
Cited Papers

Cited Papers

Grey Wolf Optimizer
err2014-03-01
err1.3W
PREAI
errMirjalili, Seyedali; Mirjalili, Seyed Mohammad; Lewis, Andrew
errShare
errSave
A Micro-GA Embedded PSO Feature Selection Approach to Intelligent Facial Emotion Recognition
err2017-06-01
err282
errOAAI
errMistry, Kamlesh; Zhang, Li; Neoh, Siew Chin; Lim, Chee Peng; Fielding, Ben
errShare
errSave
IoT Based Disease Prediction Using Mapreduce and LSQN3 Techniques
err2022-01-01
err0
errOAAI
errR. Gopi; S. Veena; S. Balasubramanian; D. Ramya; P. Ilanchezhian; A. Harshavardhan; Zatin Gupta
errShare
errSave
Multi-Label Nonlinear Matrix Completion With Transductive Multi-Task Feature Selection for Joint MGMT and IDH1 Status Prediction of Patient With High-Grade Gliomas
err2018-08-01
err27
errOAAI
errChen, Lei; Zhang, Han; Lu, Junfeng; Thung, Kimhan; Aibaidula, Abudumijiti; Liu, Luyan; Chen, Songcan; Jin, Lei; Wu, Jinsong; Wang, Qian; Zhou, Liangfu; Shen, Dinggang
errShare
errSave
Evolutionary Multitasking for Large-Scale Multiobjective Optimization
err2023-08-01
err25
PREAI
errLiu, Songbai; Lin, Qiuzhen; Feng, Liang; Wong, Ka-Chun; Tan, Kay Chen
errShare
errSave
researcher View more