.png){kind=icon}
返回
Contextual Dependency Vision Transformer for spectrogram-based multivariate time series analysis
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.127215.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multivariate time series (MTS) analysis plays an important role in various real -world applications. Existing Transformer -based methods address this problem based on hierarchical semantic representations across different scales. However, most of them ignore exploiting the helpful multiple temporal and variable relationships within the hierarchical semantic representations. To this end, this paper proposes a novel method named Contextual Dependency Vision Transformer (CD-ViT), which generates multi -grained semantic information based on spectrogram and explores mutual dependencies between multi -variable and multi -temporal representations. CD-ViT contains two key modules, i.e., the Hierarchical Variable -dependency Transformer (HVT) module and the Bidirectional Temporal -dependency Interaction (BTI) module. Specifically, the HVT module progressively establishes mutual dependencies between multiple variables, from fine to coarse scales, with shared parameters. The BTI module employs two bidirectional flows to fuse multi -temporal tokens through zoom -in and zoom -out operations. Comprehensive experiments on widely used datasets, including UEA, Olszewski, UCI, MIMIC III, and ETT, demonstrate that the proposed approach achieves significant improvement on three popular tasks, i.e., classification, regression, and forecasting. The code is available at https://github.com/Kali-github/CD-ViT.
Keyword:
Multivariate times series analysis
Hierarchical vision-style transformer
Spectrogram-based contextual interaction
Multi-variables dependency
Multi-temporal dependency
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Multivariate time series forecasting via attention-based encoder-decoder framework.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
Cluster-aware attentive convolutional recurrent network for multivariate time-series forecastingNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容