.png){kind=icon}
返回
MTT: Multi-Scale Temporal Transformer for Skeleton-Based Action Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/LSP.2022.3142675.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In the task of skeleton-based action recognition, long-term temporal dependencies are significant cues for sequential skeleton data. State-of-the-art methods rarely have access to long-term temporal information, due to the limitations of their receptive fields. Meanwhile, most of the recent multiple branches methods only consider different input modalities but ignore the information in various temporal scales. To address the above issues, we propose a multi-scale temporal transformer (MTT) in this letter, for skeleton-based action recognition. Firstly, the raw skeleton data are embedded by graph convolutional network (GCN) blocks and multi-scale temporal embedding modules (MT-EMs), which are designed as multiple branches to extract features in various temporal scales. Secondly, we introduce transformer encoders (TE) to integrate embeddings and model the long-term temporal pattern. Moreover, we propose a task-oriented lateral connection (LaC) aiming to align semantical hierarchies. LaC distributes input embeddings to the downstream transformer encoders (TE), according to semantical levels. The classification headers aggregate results from TE and predict the action categories at last. The proposed method is shown efficiency and universality during experiments and achieves the state-of-the-art on three large datasets, NTU-RGBD 60, NTU-RGBD 120 and Kinetics-Skeleton 400.
Keyword:
Feature extraction
Transformers
Kernel
Skeleton
Data mining
Task analysis
Convolution
Skeleton-based action recognition
transformer
lateral connection
multi-scale temporal embedding
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
Predictively encoded graph convolutional network for noise-robust skeleton-based action recognition基于预测编码的图卷积网络，用于噪声鲁棒的基于骨架的动作识别.png)
APPLIED INTELLIGENCE
OAAI
APPLIED INTELLIGENCEIF3.5
OAAI分享收藏Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study IIPLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor AirOAAI
Indoor AirIF0
OAAI分享收藏分享收藏Enhanced skeleton visualization for view invariant human action recognition用于视图不变人体动作识别的增强骨架可视化PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容