.png){kind=icon}
返回
Multi-granular spatial-temporal synchronous graph convolutional network for robust action recognition
.png){kind=icon}
PRE
AI
DOI：10.1016/j.eswa.2024.124980.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Graph Convolutional Networks (GCNs) have shown great potential in skeleton-based human action recognition. However, due to the diversity and complexity, modeling human actions as general graphs and capturing discriminative spatial-temporal motion patterns is challenging. Besides, the inevitable interference, especially occlusion, impairs the robustness of existing methods that depend on complete skeletons. To solve these problems, we propose a Multi-Granular Spatial-Temporal Synchronous Graph Convolutional Network (MSSGCN). Firstly, we investigate three partition strategies: attribute, activity, and mixed partition strategy to optimize the weight-sharing mechanism of GCNs, which facilitates the novel Extended Adaptive Graph Convolution (EAGC) module. Secondly, we elaborate on a Multi-sliced Spatial-temporal Graph (MSTG) for multi-granular action modeling. Thirdly, we present a Synchronized Slice Encoder (Syn-STE) to simultaneously embed spatial and temporal action patterns. Then, we design Multi-granular Spatial-temporal Encoders (MultiSTE) with multi-branch Syn-STE to generate multi-granular context. The extensive experiments verified that MSS-GCN is more robust and outperforms benchmarks on NTU-RGB+D, NTU-RGB+D 120, and NW-UCLA datasets.
Keyword:
Action recognition
Graph convolutional networks
Spatial-temporal modeling
Multi-granular analysis
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
分享收藏Fusing Higher-Order Features in Graph Neural Networks for Skeleton-Based Action Recognition融合高阶特征的图神经网络骨架动作识别
OAAI
OAAI分享收藏Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏
查看更多内容