arrow
Return

Enhanced decoupling graph convolution network for skeleton-based action recognition

delete2023-10-26
delete1
PRE
AI
古
古悦 (Yue Gu)
Q
Qiang Yu
W
Wanli Xue *
DOI:10.1007/s11042-023-17176-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In skeleton-based action recognition, graph convolution networks have been widely applied and very successful. However, because graph convolution is a local operation with a small field of perception, it cannot investigate well for the connections between joints that are far apart in the skeleton graph. In addition, graph convolution makes all channels share the same adjacency matrix, which causes the topology learned to be the same among different channels, which limits the ability of graph convolution to learn topological information. In this paper, we propose an enhanced decoupling graph convolution network that effectively expands the perceptual field of the graph convolution by adding additional graphs, and the decoupled feature fusion mechanism increases its expressive power. In addition, we introduce an attention mechanism in the model to obtain the important elements in the whole feature map from both spatial and temporal dimensions simultaneously, so that the graph convolution can focus on the important elements more precisely and efficiently and suppress the influence of irrelevant elements on the model performance. To validate the effectiveness and advancedness of the proposed model, we conducted extensive experiments on three large datasets: NTU RGB+D 60, NTU RGB+D120 and Northwestern-UCLA. On the NTU RGB+D 60 dataset, the accuracy of our model archieves 91.6% and 96.5% on the two protocols.
Keywords:
Action recognition
Graph convolution networks
Attention mechanism

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
2.0W
Citations:
3.2W

Organization

T
Tianjin University of Technology
Scholars:
8.8K
Papers: 5.9K
Citations: 1.0W
Cited Papers

Cited Papers

A prospective study of surgical margin status in oral squamous cell carcinoma: A preliminary report
err2008-12-12
err0
PREAI
errRan Yahalom; Alex Dobriyan; Marilena Vered; Yoav P. Talmi; Shlomo Teicher; Lev Bedrin
errShare
errSave
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
errShare
errSave
Charge-optimized many-body (COMB) potential for zirconium
err2013-10-01
err0
PREAI
errMark J. Noordhoek; Tao Liang; Zizhe Lu; Tzu-Ray Shan; Susan B. Sinnott; Simon R. Phillpot
errShare
errSave
A spatial attentive and temporal dilated (SATD) GCN for skeleton-based action recognition
err2021-03-17
err76
errOAAI
errZhang, Jiaxu; Ye, Gaoxiang; Tu, Zhigang; Qin, Yongtao; Qin, Qianqing; Zhang, Jinlu; Liu, Jun
errShare
errSave
researcher View more