arrow
返回

Gradient Boosting With Moving-Average Terms for Nonlinear Sequential Regression

delete2023-01-01
delete1
PRE
AI
E
Emirhan Ilhan *
M
Mehmet Y. Turali
S
Süleyman S. Kozat
DOI:10.1109/LSP.2023.3309577delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We investigate sequential nonlinear regression and introduce a novel gradient boosting algorithm that exploits the residuals, i.e., prediction errors, as additional features, as inspired by the well-known linear auto-regressive-moving-average (ARMA) models. Our algorithm utilizes the state information from early time steps contained in the residuals to improve the performance in a nonlinear sequential regression/prediction framework. The algorithm exploits the changes in the previous time steps through residual terms between boosting steps by jointly optimizing the model parameters and the feature vectors. For this optimization, we define an iterative procedure in which we alternate between two steps where the former evaluates the optimal base learner parameters for fixed residual values, and the latter updates the residuals given the new parameters. We show through both artificial and well-known real-life competition datasets that our method significantly outperforms the state-of-the-art.
Keyword:
ARMA
gradient boosting machine (GBM)
nonlinear models
sequential learning

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

I
ihsan dogramaci bilkent university
学者数:
3.6K
论文数: 3.5K
被引数: 8
引用论文

引用论文

err分享
err收藏
NonSTOP: A NonSTationary Online Prediction Method for Time Series
err2018-10-01
err9
errOAAI
errXie, Christopher; Bijral, Avleen; Ferres, Juan Lavista
err分享
err收藏
The M4 Competition: 100,000 time series and 61 forecasting methods
err2020-01-01
err473
errOAAI
errMakridakis, Spyros; Spiliotis, Evangelos; Assimakopoulos, Vassilios
err分享
err收藏
An intelligent hybridization of ARIMA with machine learning models for time series forecasting
err2019-07-01
err115
PREAI
errSantos Junior, Domingos S. de O.; de Oliveira, Joao F. L.; de Mattos Neto, Paulo S. G.
err分享
err收藏
Adaptive System Identification via Low-Rank Tensor Decomposition
err2021-01-01
err3
errOAAI
errAuer, Christina; Ploder, Oliver; Paireder, Thomas; Kovacs, Peter; Lang, Oliver; Huemer, Mario
err分享
err收藏
学者 查看更多内容