.png){kind=icon}
Return
Gradient Boosting With Moving-Average Terms for Nonlinear Sequential Regression
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2023.3309577.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We investigate sequential nonlinear regression and introduce a novel gradient boosting algorithm that exploits the residuals, i.e., prediction errors, as additional features, as inspired by the well-known linear auto-regressive-moving-average (ARMA) models. Our algorithm utilizes the state information from early time steps contained in the residuals to improve the performance in a nonlinear sequential regression/prediction framework. The algorithm exploits the changes in the previous time steps through residual terms between boosting steps by jointly optimizing the model parameters and the feature vectors. For this optimization, we define an iterative procedure in which we alternate between two steps where the former evaluates the optimal base learner parameters for fixed residual values, and the latter updates the residuals given the new parameters. We show through both artificial and well-known real-life competition datasets that our method significantly outperforms the state-of-the-art.
Keywords:
ARMA
gradient boosting machine (GBM)
nonlinear models
sequential learning
Journal
IF:
9.6
Papers:
1.1W
Citations:
1.7W
Organization
Cited Papers
ShareSave
A novel hybridization of nonlinear grey model and linear ARIMA residual correction for forecasting US shale oil production.png)
ENERGY
ENERGYIF9.4
PREAI
ShareSaveA novel hybridization of artificial neural networks and ARIMA models for time series forecasting
PREAI
ShareSaveLearning Sentimental and Financial Signals With Normalizing Flows for Stock Movement Prediction
PREAI
ShareSaveShareSave
View more