.png){kind=icon}
返回
Relation-mining self-attention network for skeleton-based human action recognition
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2023.109455.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Modeling spatiotemporal global dependencies and dynamics of body joints are crucial to recognizing ac-tions from 3D skeleton sequences. We propose a Relation-mining Self-Attention Network (RSA-Net) for skeleton-based human action recognition. The proposed RSA-Net is motivated by two important obser-vations: (1) body joint relationships can be modeled independently as pairwise and unary to reduce the difficulty of action feature learning. (2) Computing action semantics and position information inde-pendently removes noisy correlations over heterogeneous embedding. The proposed RSA-Net contains pairwise self-attention, unary self-attention, and position embedding attention modules. The pairwise self-attention captures the relationship between every two body joints. The unary self-attention learns a general correlation features among one key joint over all other query joints. The position embedding attention module computes the correlation between action semantics and position information indepen-dently with separate projection matrices. Extensive evaluations are performed in the NTU-60, NTU-120, and UESTC datasets with CS, CV, CSet, and A-view evaluation benchmarks. The proposed RSA-Net outper-forms existing transformer-based approaches and comparable results with state-of-the-art graph ConvNet methods. The source code is available in Github1.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Action recognition
Relation-mining self-attention
Pairwise self-attention
Unary self-attention
Position attention
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
暂无机构信息
引用论文
View-invariant action recognition via Unsupervised AttentioN Transfer (UANT).png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study IIPLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Enhanced skeleton visualization for view invariant human action recognition用于视图不变人体动作识别的增强骨架可视化PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Arbitrary-view human action recognition via novel-view action generationPATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容