arrow
Return

Ensemble based fully convolutional transformer network for time series classification

delete2024-07-04
delete1
PRE
AI
Y
Yilin Dong *
Y
Yuzhuo Xu
周日贵 cover
周日贵 (Ri‐Gui Zhou)
C
Changming Zhu
金
金磊 (Jin Liu)
J
Jiamin Song
X
Xinliang Wu
DOI:10.1007/s10489-024-05649-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Currently, multivariate time series classification is widely used in various fields, including industrial process control, action recognition, and health monitoring. Due to their sequential modeling capabilities, Transformer networks with self-attention mechanisms have been successfully applied to multivariate time series classification tasks. However, the original transformer network can only calculate the relative dependence between two adjacent time steps, which makes it difficult to find local continuous dependence from scattered time steps. To address this issue, we propose an ensemble model called Ensemble Based Fully Convolutional Transformer Network (E-FCTN) that combines a gated transformer network (GTN) and a fully convolutional neural network (FCN). In the E-FCTN ensemble model, the GTN calculates the attention matrix between channels and time steps in a multivariate time series. Meanwhile, the FCN is also applied to extract local features to construct the basic belief assignment. Using the Proportional Conflict Redistribution rule no. 5 (PCR5) in the Dezert-Smarandache theory (DSmT), the output of the FCN and GTN are fused at the decision level, and the final decision is made according to the maximum plausibility. The information extracted by the FCN compensates for the deficiency of the GTN in local feature extraction. Finally, the proposed method is validated on eight publicly available datasets to demonstrate its effectiveness.
Keywords:
Time series classification
Transformer
GTN
FCN
Decision-level fusion

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

S
Shanghai Maritime University
Scholars:
4.8K
Papers: 4.2K
Citations: 4.7K
Cited Papers

Cited Papers

New polymeric chemical sensors for determination of lead ions
err2009-03-28
err0
PREAI
errD. O. Kirsanov; O. V. Mednova; E. N. Pol’shin; A. V. Legin; M. Yu. Alyapyshev; I. I. Eliseev; V. A. Babain; Yu. G. Vlasov
errShare
errSave
errShare
errSave
Quantitative ionization energies and work functions of aqueous solutions
err2016-01-01
err0
errOAAI
errGiorgia Olivieri; Alok Goel; Armin Kleibert; Dean Cvetko; Matthew A. Brown
errShare
errSave
Learning-based shapelets discovery by feature selection for time series classification
err2022-01-06
err8
PREAI
errChen, Jiahui; Wan, Yuan; Wang, Xiaoyu; Xuan, Yinglv
errShare
errSave
Evaluation of pepsin derived tilapia fish waste protein hydrolysate as a feed ingredient for silver pompano (Trachinotus blochii) fingerlings: Influence on growth, metabolism, immune and disease resistance
err2021-02-01
err0
PREAI
errC.S. Tejpal; P. Vijayagopal; K. Elavarasan; D.L. Prabu; R.G.K. Lekshmi; R. Anandan; E. Sanal; K.K. Asha; N.S. Chatterjee; S. Mathew; C.N. Ravishankar
errShare
errSave
errShare
errSave
researcher View more