.png){kind=icon}
返回
Densely Knowledge-Aware Network for Multivariate Time Series Classification
.png){kind=icon}
OA
AI
DOI：10.1109/TSMC.2023.3342640.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multivariate time series classification (MTSC) based on deep learning (DL) has attracted increasingly more research attention. The performance of a DL-based MTSC algorithm is heavily dependent on the quality of the learned representations providing semantic information for downstream tasks, e.g., classification. Hence, a model's representation learning ability is critical for enhancing its performance. This article proposes a densely knowledge-aware network (DKN) for MTSC. The DKN's feature extractor consists of a residual multihead convolutional network (ResMulti) and a transformer-based network (Trans), called ResMulti-Trans. ResMulti has five residual multihead blocks for capturing the local patterns of data while Trans has three transformer blocks for extracting the global patterns of data. Besides, to enable dense mutual supervision between lower-and higher-level semantic information, this article adapts densely dual self-distillation (DDSD) for mining rich regularizations and relationships hidden in the data. Experimental results show that compared with 5 state-of-the-art self-distillation variants, the proposed DDSD obtains 13/4/13 in terms of win/tie/lose and gains the lowest-AVG_rank score. In particular, compared with pure ResMulti-Trans, DKN results in 20/1/9 regarding win/tie/lose. Last but not least, DKN overweighs 18 existing MTSC algorithms on 10 UEA2018 datasets and achieves the lowest-AVG_rank score.
Keyword:
Data mining
deep learning (DL)
knowledge distillation (KD)
multivariate time series classification (MTSC)
transformer
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
HIVE-COTE 2.0: a new meta ensemble for time series classificationHive-cote 2.0: 一种新的时间序列分类元集成.png)
MACHINE LEARNINGOAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏分享收藏Anomaly Detection Based on Convolutional Recurrent Autoencoder for IoT Time Series基于卷积递归自编码器的物联网时间序列异常检测
PREAI
分享收藏
查看更多内容