arrow
Return

Gradient boosted bagging for evolving data stream regression

delete2025-08-06
delete0
delete
OA
AI
N
Nuwan Gunasekara *
B
Bernhard Pfahringer
H
Heitor Murilo Gomes
A
Albert Bifet
DOI:10.1007/s10618-025-01147-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Gradient boosting has been extensively studied in batch learning. Recently, its streaming adaptation, Streaming Gradient Boosted Trees (Sgbt), has surpassed existing state-of-the-art random subspace and random patches methods for streaming classification under various drift scenarios. However, its application in streaming regression remains unexplored. Vanilla Sgbt with squared loss exhibits high variance when applied to streaming regression problems. To address this, we utilize bagging streaming regressors in this work to create Streaming Gradient Boosted Regression (Sgbr). Bagging streaming regressors are employed in two ways: first, as base learners within the existing Sgbt framework, and second, as an ensemble method that aggregates multiple Sgbts. Our extensive experiments on 11 streaming regression datasets, encompassing multiple drift scenarios, demonstrate that the Sgb(Oza), a variant of the first Sgbr category, significantly outperforms current state-of-the-art streaming regression methods in terms of both predictive power and computational cost.
Keywords:
Stream learning
Gradient boosting
Gradient boosted bagging
Gradient boosted regression
Data stream boosting
Streaming regression
Streaming gradient boosting
Streaming gradient boosted bagging
Streaming gradient boosted regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Data Mining and Knowledge Discovery cover
Data Mining and Knowledge Discovery
IF:
4.3
Papers:
221
Citations:
6.0K

Organization

A
ai institute
Scholars:
24
Papers: 9
Citations: 0
H
Halmstad University
Scholars:
948
Papers: 930
Citations: 995
V
Victoria University of Wellington
Scholars:
566
Papers: 317
Citations: 6.2K
researcher View more organizations
Cited Papers

Cited Papers

Real-Time Energy Pricing in New Zealand: An Evolving Stream Analysis
err2025-01-01
err0
PREAI
errSun,Yibin; Gomes,Heitor Murilo; Pfahringer,Bernhard; Bifet,Albert
errShare
errSave
Gradient boosted trees for evolving data streams
err2024-03-22
err2
errOAAI
errGunasekara, Nuwan; Pfahringer, Bernhard; Gomes, Heitor; Bifet, Albert
errShare
errSave
Online Extra Trees Regressor
err2023-10-01
err23
PREAI
errMastelini, Saulo Martiello; Nakano, Felipe Kenji; Vens, Celine; de Leon Ferreira de Carvalho, Andre Carlos Ponce
errShare
errSave
Elastic gradient boosting decision tree with adaptive iterations for concept drift adaptation
err2022-06-01
err24
PREAI
errWang, Kun; Lu, Jie; Liu, Anjin; Song, Yiliao; Xiong, Li; Zhang, Guangquan
errShare
errSave
Stream Learning in Energy IoT Systems: A Case Study in Combined Cycle Power Plants
err2020-02-08
err0
errOAAI
errJesus L. Lobo; Igor Ballesteros; Izaskun Oregi; Javier Del Ser; Sancho Salcedo-Sanz
errShare
errSave
Learning model trees from evolving data streams
err2010-10-15
err0
PREAI
errElena Ikonomovska; João Gama; Sašo Džeroski
errShare
errSave
researcher View more