返回
Gradient Boosting With Moving-Average Terms for Nonlinear Sequential Regression
DOI:10.1109/LSP.2023.3309577.png)
摘要
En 中文
We investigate sequential nonlinear regression and introduce a novel gradient boosting algorithm that exploits the residuals, i.e., prediction errors, as additional features, as inspired by the well-known linear auto-regressive-moving-average (ARMA) models. Our algorithm utilizes the state information from early time steps contained in the residuals to improve the performance in a nonlinear sequential regression/prediction framework. The algorithm exploits the changes in the previous time steps through residual terms between boosting steps by jointly optimizing the model parameters and the feature vectors. For this optimization, we define an iterative procedure in which we alternate between two steps where the former evaluates the optimal base learner parameters for fixed residual values, and the latter updates the residuals given the new parameters. We show through both artificial and well-known real-life competition datasets that our method significantly outperforms the state-of-the-art.
Keyword:
ARMA
gradient boosting machine (GBM)
nonlinear models
sequential learning
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
A novel hybridization of nonlinear grey model and linear ARIMA residual correction for forecasting US shale oil production预测美国页岩油产量的非线性灰色模型和线性ARIMA残差修正的新混合
ENERGY
IF9.4

