arrow
Return

A two-layer feature selection method using Genetic Algorithm and Elastic Net

delete2021-03-01
delete101
delete
OA
AI
F
Fatemeh Amini
G
Guiping Hu *
DOI:10.1016/j.eswa.2020.114072delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Feature selection, as a critical pre-processing step for machine learning, aims at determining representative predictors from a high-dimensional feature space dataset to improve the prediction accuracy. However, the increase in feature space dimensionality, comparing to the number of observations, poses a severe challenge to many existing feature selection methods considering computational efficiency and prediction performance. This paper presents a new two-layer feature selection approach that combines a wrapper and an embedded method in constructing an appropriate subset of predictors. In the first layer of the proposed method, Genetic Algorithm (GA) has been adopted as a wrapper to search for the optimal subset of predictors, which aims to reduce the number of predictors and the prediction error. As one of the meta-heuristic approaches, GA is selected due to its computational efficiency; however, GAs do not guarantee the optimality. To address this issue, a second layer is added to the proposed method to eliminate any remaining redundant/irrelevant predictors to improve the prediction accuracy. Elastic Net (EN) has been selected as the embedded method in the second layer because of its flexibility in adjusting the penalty terms in the regularization process and time efficiency. This two-layer approach has been applied on a Maize genetic dataset from NAM population, which consists of multiple subsets of datasets with different ratios of the number of predictors to the number of observations. The numerical results confirm the superiority of the proposed model.
Keywords:
Genetic Algorithms
Elastic Net
Feature selection
High-dimensional datasets
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

I
Iowa State University
Scholars:
2.1W
Papers: 1.8W
Citations: 2.5W
Cited Papers

Cited Papers

Fault diagnosis in spur gears based on genetic algorithm and random forest
err2016-03-01
err282
PREAI
errCerrada, Mariela; Zurita, Grover; Cabrera, Diego; Sanchez, Rene-Vinicio; Artes, Mariano; Li, Chuan
errShare
errSave
errShare
errSave
Genetic algorithm based feature selection combined with dual classification for the automated detection of proliferative diabetic retinopathy
err2015-07-01
err114
errOAAI
errWelikala, R. A.; Fraz, M. M.; Dehmeshki, J.; Hoppe, A.; Tah, V.; Mann, S.; Williamson, T. H.; Barman, S. A.
errShare
errSave
The evolution and functional divergence of the histone H2B family in plants
err2020-07-27
err0
errOAAI
errDanhua Jiang; Michael Borg; Zdravko J. Lorković; Sean A. Montgomery; Akihisa Osakabe; Ramesh Yelagandula; Elin Axelsson; Frédéric Berger
errShare
errSave
researcher View more