arrow
返回

Online Extra Trees Regressor

delete2023-10-01
delete23
PRE
AI
S
Saulo Martiello Mastelini *
F
Felipe Kenji Nakano
C
Celine Vens
A
André C. P. L. F. de Carvalho
DOI:10.1109/TNNLS.2022.3212859delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data production has followed an increased growth in the last years, to the point that traditional or batch machine-learning (ML) algorithms cannot cope with the sheer volume of generated data. Stream or online ML presents itself as a viable solution to deal with the dynamic nature of streaming data. Besides coping with the inherent challenges of streaming data, online ML solutions must be accurate, fast, and bear a reduced memory footprint. We propose a new decision tree-based ensemble algorithm for online ML regression named online extra trees (OXT). Our proposal takes inspiration from the batch learning extra trees (XT) algorithm, a popular and faster alternative to random forest (RF). While speed and memory costs might not be a central concern in most batch applications, they become crucial in data stream data learning. Our proposal combines subbagging (sampling without replacement), random tree split points, and model trees to deliver competitive prediction errors and reduced computational costs. Throughout an extensive experimental evaluation comprising 22 real-world and synthetic datasets, we compare OXT against the state-of-the-art adaptive RF (ARF) and other incremental regressors. OXT is generally more accurate than its competitors while running significantly faster than ARF and expending significantly less memory.
Keyword:
Random forests
Bagging
Regression tree analysis
Prediction algorithms
Radio frequency
Proposals
Task analysis
Extra trees (XT)
online learning
regression
stream learning

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

K
KU Leuven
学者数:
5.7W
论文数: 5.2W
被引数: 8.1W
U
universidade de sao paulo
学者数:
10.6W
论文数: 6.7W
被引数: 93
引用论文

引用论文

A Survey on Ensemble Learning for Data Stream Classification面向数据流分类的集成学习研究综述
err2017-03-27
err378
PREAI
errGomes, Heitor Murilo; Barddal, Jean Paul; Enembreck, Fabricio; Bifet, Albert
err分享
err收藏
Ensemble learning for data stream analysis: A survey用于数据流分析的集成学习: 综述
err2017-09-01
err672
errOAAI
errKrawczyk, Bartosz; Minku, Leandro L.; Gama, Joao; Stefanowski, Jerzy; Wozniak, Michal
err分享
err收藏
Learning under Concept Drift: A Review
err2018-01-01
err922
errOAAI
errLu, Jie; Liu, Anjin; Dong, Fan; Gu, Feng; Gama, Joao; Zhang, Guangquan
err分享
err收藏
Bagging predictorsBagging预测器
err1996-08-01
err1.0W
PREAI
errBreiman, L
err分享
err收藏
err分享
err收藏
A survey on ensemble learning集成学习研究综述
err2019-08-30
err1.1K
PREAI
errDong, Xibin; Yu, Zhiwen; Cao, Wenming; Shi, Yifan; Ma, Qianli
err分享
err收藏
Using dynamical quantization to perform split attempts in online tree regressors
err2021-05-01
err5
errOAAI
errMastelini, Saulo Martiello; de Leon Ferreira de Carvalho, Andre Carlos Ponce
err分享
err收藏
学者 查看更多内容