arrow
返回

Spatial-Temporal gated graph attention network for skeleton-based action recognition

delete2023-06-22
delete5
PRE
AI
M
Mrugendrasinh Rahevar *
A
Amit Ganatra
DOI:10.1007/s10044-023-01179-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Human body skeleton, acting as a spatiotemporal graph, is the key inspiration for researchers to implement a GCN-based method for action recognition. Most recently proposed GCN-based techniques combine convolutions with a self-attention mechanism to extract the most informative joint of a human skeleton and increase the model accuracy. However, the traditional multi-head attention method absorbed all attention heads equally, whereas in most situations, especially for extended skeleton sequences, not all attention heads are expected. Therefore, we present a spatial-temporal gated graph attention network (ST-GGANet) to learn the spatial-temporal patterns of skeleton sequences. The proposed approach uses a lightweight self-attention-based gate layer to pay attention to the important body parts or joints of human skeleton sequences. Experiments show that by introducing an additional gate layer, which controls the significance of each attention head, the proposed model achieved better action classification results while keeping computational cost low. The proposed framework has been evaluated on well-known publicly available large-scale datasets NTU60, NTU120, and Kinetics-400, which notably outperforms state-of-the-art (SOTA) results with an accuracy of 96.5%, 87.3%, and 60.4%, respectively.
Keyword:
Action recognition
Graph attention network
Gated self-attention

期刊

Pattern Analysis and Applications 封面图
Pattern Analysis and Applications
IF:
2
论文数:
2.0K
被引数:
1.9K

机构

P
Parul University
学者数:
1.4K
论文数: 936
被引数: 675
C
charotar university of science & technology - charusat
学者数:
904
论文数: 621
被引数: 3
引用论文

引用论文

err分享
err收藏
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
err2018-04-01
err423
errOAAI
errLiu, Jun; Wang, Gang; Duan, Ling-Yu; Abdiyeva, Kamila; Kot, Alex C.
err分享
err收藏
Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction
err2002-07-01
err140
PREAI
errDuric, Z; Gray, WD; Heishman, R; Li, FY; Rosenfeld, A; Schoelles, MJ; Schunn, C; Wechsler, H
err分享
err收藏
The central region of the synaptonemal complex inBlaps cribrosa studied by electron microscope tomography
err1993-12-01
err0
PREAI
errKarin Schmekel; Jacob Wahrman; Ulf Skoglund; Bertil Daneholt
err分享
err收藏
学者 查看更多内容