arrow
Return

Gradient boosted bagging for evolving data stream regression

delete2025-08-06
delete0
delete
OA
AI
N
Nuwan Gunasekara *
B
Bernhard Pfahringer
H
Heitor Murilo Gomes
A
Albert Bifet
DOI:10.1007/s10618-025-01147-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Gradient boosting has been extensively studied in batch learning. Recently, its streaming adaptation, Streaming Gradient Boosted Trees (Sgbt), has surpassed existing state-of-the-art random subspace and random patches methods for streaming classification under various drift scenarios. However, its application in streaming regression remains unexplored. Vanilla Sgbt with squared loss exhibits high variance when applied to streaming regression problems. To address this, we utilize bagging streaming regressors in this work to create Streaming Gradient Boosted Regression (Sgbr). Bagging streaming regressors are employed in two ways: first, as base learners within the existing Sgbt framework, and second, as an ensemble method that aggregates multiple Sgbts. Our extensive experiments on 11 streaming regression datasets, encompassing multiple drift scenarios, demonstrate that the Sgb(Oza), a variant of the first Sgbr category, significantly outperforms current state-of-the-art streaming regression methods in terms of both predictive power and computational cost.
Keywords:
Stream learning
Gradient boosting
Gradient boosted bagging
Gradient boosted regression
Data stream boosting
Streaming regression
Streaming gradient boosting
Streaming gradient boosted bagging
Streaming gradient boosted regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Data Mining and Knowledge Discovery cover
Data Mining and Knowledge Discovery
IF:
4.3
Papers:
192
Citations:
6.0K

Organization

A
ai institute
Scholars:
24
Papers: 9
Citations: 0
H
Halmstad University
Scholars:
935
Papers: 924
Citations: 995
V
Victoria University of Wellington
Scholars:
503
Papers: 288
Citations: 6.2K
researcher View more organizations