.png){kind=icon}
返回
Temporal Decoupling Graph Convolutional Network for Skeleton-Based Gesture Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2023.3271811.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Skeleton-based gesture recognition methods have achieved high success using Graph Convolutional Network (GCN), which commonly uses an adjacency matrix to model the spatial topology of skeletons. However, previous methods use the same adjacency matrix for skeletons from different frames, which limits the flexibility of GCN to model temporal information. To solve this problem, we propose a Temporal Decoupling Graph Convolutional Network (TD-GCN), which applies different adjacency matrices for skeletons from different frames. The main steps of each convolution layer in our proposed TD-GCN are as follows. To extract deep spatiotemporal information from skeleton joints, we first extract high-level spatiotemporal features from skeleton data. Then, channel-dependent and temporal-dependent adjacency matrices corresponding to different channels and frames are calculated to capture the spatiotemporal dependencies between skeleton joints. Finally, to fuse topology information from neighbor skeleton joints, spatiotemporal features of skeleton joints are fused based on channel-dependent and temporal-dependent adjacency matrices. To the best of our knowledge, we are the first to use temporal-dependent adjacency matrices for temporal-sensitive topology learning from skeleton joints. The proposed TD-GCN effectively improves the modeling ability of GCN and achieves state-of-the-art results on gesture datasets including SHREC'17 Track and DHG-14/28.
Keyword:
Skeleton
Gesture recognition
Topology
Feature extraction
Convolutional neural networks
Network topology
Convolution
Graph convolutional network
gesture recognition
skeleton sequence
期刊
IF:
9.7
论文数:
5.2K
被引数:
2.7W
机构
引用论文
分享收藏
Ecological Awareness, Connection to Wetlands, and Wildlife Recreation as Drivers of Wetland Conservation Involvement.png)
Wetlands
WetlandsIF0
PREAI
分享收藏
查看更多内容