返回
Spatial-Temporal gated graph attention network for skeleton-based action recognition
DOI:10.1007/s10044-023-01179-3.png)
摘要
En 中文
Human body skeleton, acting as a spatiotemporal graph, is the key inspiration for researchers to implement a GCN-based method for action recognition. Most recently proposed GCN-based techniques combine convolutions with a self-attention mechanism to extract the most informative joint of a human skeleton and increase the model accuracy. However, the traditional multi-head attention method absorbed all attention heads equally, whereas in most situations, especially for extended skeleton sequences, not all attention heads are expected. Therefore, we present a spatial-temporal gated graph attention network (ST-GGANet) to learn the spatial-temporal patterns of skeleton sequences. The proposed approach uses a lightweight self-attention-based gate layer to pay attention to the important body parts or joints of human skeleton sequences. Experiments show that by introducing an additional gate layer, which controls the significance of each attention head, the proposed model achieved better action classification results while keeping computational cost low. The proposed framework has been evaluated on well-known publicly available large-scale datasets NTU60, NTU120, and Kinetics-400, which notably outperforms state-of-the-art (SOTA) results with an accuracy of 96.5%, 87.3%, and 60.4%, respectively.
Keyword:
Action recognition
Graph attention network
Gated self-attention
期刊
IF:
2
论文数:
2.0K
被引数:
1.9K
机构
引用论文
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
PLoS ONE
IF0
Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction
PROCEEDINGS OF THE IEEE
IF25.9
The central region of the synaptonemal complex inBlaps cribrosa studied by electron microscope tomography
Chromosoma
IF0

