arrow
返回

Skeleton-Based Action Recognition With Focusing-Diffusion Graph Convolutional Networks

delete2021-01-01
delete23
delete
OA
AI
J
Jialin Gao
T
Tong He
X
Xi Zhou
葛仕明 (Shiming Ge) *
DOI:10.1109/LSP.2021.3116513delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph Convolutional Networks have been successfully applied in skeleton-based action recognition. The key is fully exploring the spatial-temporal context. This letter proposes a Focusing-Diffusion Graph Convolutional Network (FDGCN) to address this issue. Each skeleton frame is first decomposed into two opposite-direction graphs for subsequent focusing and diffusion processes. Next, the focusing process generates a spatial-level representation for each frame individually by an attention module. This representation is regarded as a supernode to aggregate the feature from each joint node in each frame for spatial context extraction. After generating supernodes for the entire sequence, a transformer encoder layer is proposed to capture the temporal context further. Finally, these supernodes pass the embedded spatial-temporal context back to the spatial joints through the diffusion graph in the diffusing process. Extensive experiments on the NTU RGB+D and Skeleton-Kinetics benchmarks demonstrate the effectiveness of our approach.
Keyword:
Focusing
Convolution
Skeleton
Transformers
Hidden Markov models
Context modeling
Aggregates
Focusing and diffusion
bidirectional attention
graph convolutional network
action recognition

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
U
university of california los angeles
学者数:
5.3W
论文数: 4.2W
被引数: 89
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling
err2015-11-01
err68
errOAAI
errJiang, Yu-Gang; Dai, Qi; Liu, Wei; Xue, Xiangyang; Ngo, Chong-Wah
err分享
err收藏
err分享
err收藏
学者 查看更多内容