arrow
Return

Multi-generation multi-criteria feature construction using Genetic Programming

delete2023-04-01
delete5
PRE
AI
马
马建斌 (Jianbin Ma) *
X
Xiaoying Gao
李
李英 (Ying Li)
DOI:10.1016/j.swevo.2023.101285delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The purpose of feature construction is to create new high level features from the original features. When Genetic Programming (GP) is applied to wrapper-based feature construction, especially when the samples size is small, GP generally overfits the training set and generalizes poorly with the deepening of evolution. Overfitting has attracted wide attention in some classification models, however, it is not commonly studied in the field of feature construction. In this paper, a Multi-Generation feature construction method (MG) is developed to preserve the solutions produced by multiple generations of GP. A Multi-Criteria feature construction method (MC) is introduced to use a multi-criteria evaluation function to evaluate GP individuals. Combining the above two methods, a Multi-Generation Multi-Criteria feature construction method (MGMC) is proposed. Experiments on fourteen datasets show that the proposed MG and MC methods can improve the classification performance and overcome overfitting problems of traditional feature construction methods in most cases. The combined MGMC method further improves the classification performance and achieves the best results.
Keywords:
Feature construction
Genetic programming
Overfitting
Multi-generation
Multi-criteria

Journal

Swarm and Evolutionary Computation cover
Swarm and Evolutionary Computation
IF:
8.5
Papers:
2.2K
Citations:
1.0W

Organization

H
Hebei Agricultural University
Scholars:
7.8K
Papers: 4.1K
Citations: 6.9K
Cited Papers

Cited Papers

The Naive Overfitting Index Selection (NOIS): A new method to optimize model complexity for hyperspectral data
err2017-11-01
err19
errOAAI
errRocha, Alby D.; Groen, Thomas A.; Skidmore, Andrew K.; Darvishzadeh, Roshanak; Willemen, Louise
errShare
errSave
errShare
errSave
Markov blanket-embedded genetic algorithm for gene selection
err2007-11-01
err324
PREAI
errZhu, Zexuan; Ong, Yew-Soon; Dash, Manoranjan
errShare
errSave
researcher View more