.png){kind=icon}
返回
Fast linear model trees by PILOT
.png){kind=icon}
OA
AI
DOI：10.1007/s10994-024-06590-3.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Linear model trees are regression trees that incorporate linear models in the leaf nodes. This preserves the intuitive interpretation of decision trees and at the same time enables them to better capture linear relationships, which is hard for standard decision trees. But most existing methods for fitting linear model trees are time consuming and therefore not scalable to large data sets. In addition, they are more prone to overfitting and extrapolation issues than standard regression trees. In this paper we introduce PILOT, a new algorithm for linear model trees that is fast, regularized, stable and interpretable. PILOT trains in a greedy fashion like classic regression trees, but incorporates an L2 boosting approach and a model selection rule for fitting linear models in the nodes. The abbreviation PILOT stands for PIecewise Linear Organic Tree, where 'organic' refers to the fact that no pruning is carried out. PILOT has the same low time and space complexity as CART without its pruning. An empirical study indicates that PILOT tends to outperform standard decision trees and other linear model trees on a variety of data sets. Moreover, we prove its consistency in an additive model setting under weak assumptions. When the data is generated by a linear model, the convergence rate is polynomial.
Keyword:
Consistency
Piecewise linear model
Regression trees
Scalable algorithms
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
引用论文
分享收藏Mapping of cropland, cropping patterns and crop types by combining optical remote sensing images with decision tree classifier and random forest通过将光学遥感图像与决策树分类器和随机森林相结合来映射农田，种植方式和作物类型OAAI
OAAI分享收藏
分享收藏A novel decomposition-ensemble learning framework for multi-step ahead wind energy forecasting.png)
ENERGY
ENERGYIF9.4
PREAI
分享收藏
查看更多内容