arrow
返回

Modular Multitree Genetic Programming for Evolutionary Feature Construction for Regression

delete2024-10-01
delete2
PRE
AI
H
Hengzhe Zhang
陈琦 (Qi Chen) *
B
Bing Xue
W
Wolfgang Banzhaf
张梦杰 封面图
张梦杰 (Mengjie Zhang)
DOI:10.1109/TEVC.2023.3318638delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Evolutionary feature construction is a key technique in evolutionary machine learning, with the aim of constructing high-level features that enhance performance of a learning algorithm. In real-world applications, engineers typically construct complex features based on a combination of basic features, reusing those features as modules. However, modularity in evolutionary feature construction is still an open research topic. This article tries to fill that gap by proposing a modular and hierarchical multitree genetic programming (GP) algorithm that allows trees to use the output values of other trees, thereby representing expressive features in a compact form. Based on this new representation, we propose a macro parent-repair strategy to reduce redundant and irrelevant features, a macro crossover operator to preserve interactive features, and an adaptive control strategy for crossover and mutation rates to dynamically balance the tradeoff between exploration and exploitation. A comparison with seven bloat control methods on 98 regression datasets shows that the proposed modular representation achieves significantly better results in terms of test performance and smaller model size. Experimental results on the state-of-the-art acrlong SRBench demonstrate that the proposed symbolic regression method outperforms 22 existing symbolic regression and machine learning algorithms, providing empirical evidence for the superiority of the modularized evolutionary feature construction method.
Keyword:
Genetic programming
Task analysis
Semantics
Random forests
Machine learning algorithms
Computational modeling
Contracts
Evolutionary feature construction
evolutionary forest
genetic programming (GP)
modularity
random forest

期刊

IEEE Transactions on Evolutionary Computation 封面图
IEEE Transactions on Evolutionary Computation
IF:
12
论文数:
1.8K
被引数:
2.4W

机构

V
Victoria University Wellington
学者数:
5.6K
论文数: 5.9K
被引数: 54
M
michigan state university
学者数:
3.6W
论文数: 3.2W
被引数: 44
引用论文

引用论文

Beyond the Numbers: An Analysis of Optimistic and Pessimistic Language in Earnings Press Releases
err
IF0
err2006-01-01
err0
errOAAI
errAngela K. Davis; Jeremy M. Piger; Lisa M. Sedor
err分享
err收藏
PMLB: a large benchmark suite for machine learning evaluation and comparison
err2017-12-11
err223
errOAAI
errOlson, Randal S.; La Cava, William; Orzechowski, Patryk; Urbanowicz, Ryan J.; Moore, Jason H.
err分享
err收藏
A Technical System for the Large-Scale Application of Metabolites From Paecilomyces variotii SJ1 in Agriculture
err2021-05-12
err0
errOAAI
errQingbin Wang; Chune Peng; Liran Shi; Zhiguang Liu; Dafa Zhou; Hui Meng; Hongling Zhao; Fuchuan Li; Min Zhang
err分享
err收藏
err分享
err收藏
SR-Forest: A Genetic Programming-Based Heterogeneous Ensemble Learning Method
err2024-10-01
err7
PREAI
errZhang, Hengzhe; Zhou, Aimin; Chen, Qi; Xue, Bing; Zhang, Mengjie
err分享
err收藏
学者 查看更多内容