arrow
返回

Attention-based gating optimization network for multivariate time series prediction

delete2022-09-01
delete8
PRE
AI
X
Xiulin Geng
X
Xiaoyu He
L
Lingyu Xu *
J
Jie Yu *
DOI:10.1016/j.asoc.2022.109275delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Multivariate time series prediction is helpful for scientific decision-making and reliable assessments in numerous fields. Capturing time series nonlinear change rules with increasing dependency complexity among multivariate time series remains challenging. We propose an attention-based gating optimiza-tion network (AGON) to solve this issue. To relieve the conflict between external and target factors, the AGON divides the original time series into external factors and target factor for two parallel encoder inputs. One encoder employs feature-perceived attention to distinguish external factors' contributions and limit the impact of low-contributing factors on high-level semantics. The other leverages long short term memory (LSTM) to establish the temporal dependencies of the target factor. In the decoder phase, fine-grained denoising attention is designed to assign an attention weight vector instead of a single scalar to filter fine-grained harmful noise in the hidden state to the uttermost. Finally, information fusion LSTM is introduced to maintain the output balance between external and target factors. An extensive experiment of three fields of energy, environment, and finance (wind speed, PM2.5, four stock datasets) is presented. AGON is able to achieve 38%, 37%, and 46% improvements in the average MAE, RMSE, and MAPE results over state-of-the-art methods across all three datasets and three-step -ahead forecasting, which implies that AGON can be very competitive and holds versatility for diverse industries' multivariate time series even if the dataset presents strong fluctuation and a nonlinear changing tendency. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Attention mechanism
Information fusion
Multivariate time series prediction
Noise filtering

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

S
shanghai university
学者数:
3.9W
论文数: 2.7W
被引数: 52
引用论文

引用论文

Multivariate time series forecasting via attention-based encoder-decoder framework
err2020-05-01
err305
PREAI
errDu, Shengdong; Li, Tianrui; Yang, Yan; Horng, Shi-Jinn
err分享
err收藏
Health labs focus on mystery pneumonia
err2003-03-01
err0
errOAAI
errDavid Cyranoski
err分享
err收藏
Electron–phonon coupling reflecting dynamic charge inhomogeneity in copper oxide superconductors
err2006-04-01
err0
errOAAI
errD. Reznik; L. Pintschovius; M. Ito; S. Iikubo; M. Sato; H. Goka; M. Fujita; K. Yamada; G. D. Gu; J. M. Tranquada
err分享
err收藏
Deep Learning with Long Short-Term Memory for Time Series Prediction基于长短期记忆的深度学习时间序列预测
err2019-06-01
err339
errOAAI
errHua, Yuxiu; Zhao, Zhifeng; Li, Rongpeng; Chen, Xianfu; Liu, Zhiming; Zhang, Honggang
err分享
err收藏
Temporal pattern attention for multivariate time series forecasting
err2019-06-11
err555
errOAAI
errShih, Shun-Yao; Sun, Fan-Keng; Lee, Hung-yi
err分享
err收藏
First Human Results With the 256 Channel Intelligent Micro Implant Eye (IMIE 256)
err2021-10-27
err0
errOAAI
errHuizhuo Xu; Xingwu Zhong; Changlin Pang; Jing Zou; Wangling Chen; Xianggui Wang; Shanxiang Li; Yuntao Hu; Didier S. Sagan; Philip T. Weiss; Yangyi Yao; Jiayi Xiang; Margot S. Dayan; Mark S. Humayun; Yu-Chong Tai
err分享
err收藏
学者 查看更多内容