arrow
Return

An Evolutionary Forest for Regression

delete2022-08-01
delete21
PRE
AI
H
Hengzhe Zhang
周
周爱民 (Aimin Zhou) *
H
Hu Zhang
DOI:10.1109/TEVC.2021.3136667delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Random forest (RF) is a type of ensemble-based machine learning method that has been applied to a variety of machine learning tasks in recent years. This article proposes an evolutionary approach to generate an oblique RF for regression problems. More specifically, our method induces an oblique RF by transforming the original feature space to a new feature space through the evolutionary feature construction method. To speed up the searching process, the proposed method evaluates each set of features based on a decision tree (DT) rather than an RF. In order to obtain an RF, we archive top-performing features and corresponding trees during the search. In this way, both the features and the forest can be constructed simultaneously in a single run. The proposed evolutionary forest is applied to 117 benchmark problems with different characteristics and compared with some state-of-the-art regression methods, including several variants of the RF and gradient boosted DTs (GBDTs). The experimental results suggest that the proposed method outperforms the existing RF and GBDT methods.
Keywords:
Random forests
Decision trees
Forestry
Machine learning algorithms
Regression tree analysis
Optimization
Boosting
Evolutionary feature construction
evolutionary forest (EF)
genetic programming (GP)
random forest (RF)

Journal

IEEE Transactions on Evolutionary Computation cover
IEEE Transactions on Evolutionary Computation
IF:
12
Papers:
1.9K
Citations:
2.4W

Organization

E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25
Cited Papers

Cited Papers

PMLB: a large benchmark suite for machine learning evaluation and comparison
err2017-12-11
err223
errOAAI
errOlson, Randal S.; La Cava, William; Orzechowski, Patryk; Urbanowicz, Ryan J.; Moore, Jason H.
errShare
errSave
Meso-Mechanical Characteristics of Granite with Natural Cracks after Mud Acid Corrosion
err2022-01-19
err0
errOAAI
errRongchen Tong; Hejuan Liu; Jianfeng Liu; Yingkun Shi; Lihuan Xie; Shengnan Ban
errShare
errSave
Metals and organic species associated with fine and coarse aerosol particles in an electronic waste recycling plant
err2023-02-06
err0
PREAI
errGiulia Pazzi; Francesca Buiarelli; Patrizia Di Filippo; Donatella Pomata; Carmela Riccardi; Franco Lucarelli; Fabio Giardi; Elisa Sonego; Roberta Galarini; Stefano Lorenzetti; Laura Goracci; Giulia Simonetti
errShare
errSave
On explaining machine learning models by evolving crucial and compact features
err2020-03-01
err19
errOAAI
errVirgolin, Marco; Alderliesten, Tanja; Bosman, Peter A. N.
errShare
errSave
researcher View more