arrow
Return

Skeleton-based multi-stream adaptive-attentional sub-graph convolution network for action recognition

delete2023-05-12
delete1
PRE
AI
H
Huan Liu
J
Jian Wu
H
Haokai Ma
Y
Yuqi Yan
R
Rui He *
DOI:10.1007/s11042-023-15778-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, graph convolutional networks have achieved remarkable performance with skeleton-based action recognition methods. However, there is potential correlation between different parts of the human body. Many studies have ignored the fact that different actions are the result of the interaction of different human body parts, and that operating on the whole graph provides inadequate information to characterize the action category. In this study, to pay more attention to this problem and further improve the accuracy of action recognition models, sub-graphs based on the depth-first tree traversal order were used to represent the importance and correlation characteristics of joint and bone parts. In addition, beyond the physical structure of the body, joint and bone motion information was also introduced to represent changes in human body parts with movement. To improve the performance of this method, an adaptive-attentional mechanism was added to learn unique topology autonomously for each sample and channel domain. The multi-stream adaptive-attentional sub-graph convolution network was thus proposed for action recognition. The resulting model achieved competitive results on the NTU-RGB + D60 dataset based on 2D or 3D skeleton poses. The experimental results demonstrated the efficacy of our proposed method.
Keywords:
Action recognition
Adaptive-attentional sub-graph convolution
Depth-first tree traversal order
Multi-stream framework

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
2.0W
Citations:
3.2W

Organization

J
Jilin University
Scholars:
8.7W
Papers: 5.6W
Citations: 8.9K
Cited Papers

Cited Papers

Surge dynamics in the Nathorstbreen glacier system, Svalbard
err2014-04-11
err0
errOAAI
errM. Sund; T. R. Lauknes; T. Eiken
errShare
errSave
Diversity and productivity of plant communities across the Inland Northwest, USA
err2005-03-24
err0
PREAI
errMichael D. Jennings; John W. Williams; Mark R. Stromberg
errShare
errSave
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
errShare
errSave
Action recognition based on joint trajectory maps with convolutional neural networks
err2018-10-01
err159
errOAAI
errWang, Pichao; Li, Wanqing; Li, Chuankun; Hou, Yonghong
errShare
errSave
Action Recognition Using 3D Histograms of Texture and A Multi-Class Boosting Classifier
err2017-10-01
err135
errOAAI
errZhang, Baochang; Yang, Yun; Chen, Chen; Yang, Linlin; Han, Jungong; Shao, Ling
errShare
errSave
researcher View more