arrow
返回

DeGCN: Deformable Graph Convolutional Networks for Skeleton-Based Action Recognition

delete2024-01-01
delete3
delete
OA
AI
W
Woomin Myung
N
Nan Su
J
Jing‐Hao Xue
G
Guijin Wang *
DOI:10.1109/TIP.2024.3378886delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph convolutional networks (GCN) have recently been studied to exploit the graph topology of the human body for skeleton-based action recognition. However, most of these methods unfortunately aggregate messages via an inflexible pattern for various action samples, lacking the awareness of intra-class variety and the suitableness for skeleton sequences, which often contain redundant or even detrimental connections. In this paper, we propose a novel Deformable Graph Convolutional Network (DeGCN) to adaptively capture the most informative joints. The proposed DeGCN learns the deformable sampling locations on both spatial and temporal graphs, enabling the model to perceive discriminative receptive fields. Notably, considering human action is inherently continuous, the corresponding temporal features are defined in a continuous latent space. Furthermore, we design an innovative multi-branch framework, which not only strikes a better trade-off between accuracy and model size, but also elevates the effect of ensemble between the joint and bone modalities remarkably. Extensive experiments show that our proposed method achieves state-of-the-art performances on three widely used datasets, NTU RGB+D, NTU RGB+D 120, and NW-UCLA.
Keyword:
Skeleton-based action recognition
graph convolutional network
deformable convolution

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
引用论文

引用论文

Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
The vegetation of a New Zealand dune slack
err1987-07-01
err0
PREAI
errMartin T. Sykes; J. Bastow Wilson
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling
err2015-11-01
err68
errOAAI
errJiang, Yu-Gang; Dai, Qi; Liu, Wei; Xue, Xiangyang; Ngo, Chong-Wah
err分享
err收藏
学者 查看更多内容