arrow
返回

Spatial-Temporal Convolutional Transformer Network for Multivariate Time Series Forecasting

delete2022-01-22
delete22
delete
OA
AI
L
Lei Huang
F
Feng Mao
K
Kai Zhang
Z
Zhiheng Li *
DOI:10.3390/s22030841delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Multivariate time series forecasting has long been a research hotspot because of its wide range of application scenarios. However, the dynamics and multiple patterns of spatiotemporal dependencies make this problem challenging. Most existing methods suffer from two major shortcomings: (1) They ignore the local context semantics when modeling temporal dependencies. (2) They lack the ability to capture the spatial dependencies of multiple patterns. To tackle such issues, we propose a novel Transformer-based model for multivariate time series forecasting, called the spatial-temporal convolutional Transformer network (STCTN). STCTN mainly consists of two novel attention mechanisms to respectively model temporal and spatial dependencies. Local-range convolutional attention mechanism is proposed in STCTN to simultaneously focus on both global and local context temporal dependencies at the sequence level, which addresses the first shortcoming. Group-range convolutional attention mechanism is designed to model multiple spatial dependency patterns at graph level, as well as reduce the computation and memory complexity, which addresses the second shortcoming. Continuous positional encoding is proposed to link the historical observations and predicted future values in positional encoding, which also improves the forecasting performance. Extensive experiments on six real-world datasets show that the proposed STCTN outperforms the start-of-the-art methods and is more robust to nonsmooth time series data.
Keyword:
multivariate time series forecasting
spatiotemporal
convolutional Transformer
attention mechanism
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

T
Tsinghua Shenzhen International Graduate School
学者数:
6.8K
论文数: 4.9K
被引数: 9
引用论文

引用论文

TeTrIS: Template Transformer Networks for Image Segmentation With Shape Priors
err2019-11-01
err72
errOAAI
errLee, Matthew Chung Hai; Petersen, Kersten; Pawlowski, Nick; Glocker, Ben; Schaap, Michiel
err分享
err收藏
err分享
err收藏
Selecting an Effective Entropy Estimator for Short Sequences of Bits and Bytes with Maximum Entropy
err2021-04-30
err0
errOAAI
errLianet Contreras Rodríguez; Evaristo José Madarro-Capó; Carlos Miguel Legón-Pérez; Omar Rojas; Guillermo Sosa-Gómez
err分享
err收藏
err分享
err收藏
Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks
errSENSORS
IF3.5
err2017-06-26
err385
errOAAI
errYu, Haiyang; Wu, Zhihai; Wang, Shuqin; Wang, Yunpeng; Ma, Xiaolei
err分享
err收藏
Unlocking ensemble ecosystem modelling for large and complex networks
err2024-03-14
err0
errOAAI
errSarah A. Vollert; Christopher Drovandi; Matthew P. Adams
err分享
err收藏
学者 查看更多内容