arrow
返回

Skeleton-based multi-stream adaptive-attentional sub-graph convolution network for action recognition

delete2023-05-12
delete1
PRE
AI
H
Huan Liu
J
Jian Wu
H
Haokai Ma
Y
Yuqi Yan
R
Rui He *
DOI:10.1007/s11042-023-15778-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, graph convolutional networks have achieved remarkable performance with skeleton-based action recognition methods. However, there is potential correlation between different parts of the human body. Many studies have ignored the fact that different actions are the result of the interaction of different human body parts, and that operating on the whole graph provides inadequate information to characterize the action category. In this study, to pay more attention to this problem and further improve the accuracy of action recognition models, sub-graphs based on the depth-first tree traversal order were used to represent the importance and correlation characteristics of joint and bone parts. In addition, beyond the physical structure of the body, joint and bone motion information was also introduced to represent changes in human body parts with movement. To improve the performance of this method, an adaptive-attentional mechanism was added to learn unique topology autonomously for each sample and channel domain. The multi-stream adaptive-attentional sub-graph convolution network was thus proposed for action recognition. The resulting model achieved competitive results on the NTU-RGB + D60 dataset based on 2D or 3D skeleton poses. The experimental results demonstrated the efficacy of our proposed method.
Keyword:
Action recognition
Adaptive-attentional sub-graph convolution
Depth-first tree traversal order
Multi-stream framework

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
引用论文

引用论文

Diversity and productivity of plant communities across the Inland Northwest, USA
err2005-03-24
err0
PREAI
errMichael D. Jennings; John W. Williams; Mark R. Stromberg
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
Action recognition based on joint trajectory maps with convolutional neural networks
err2018-10-01
err159
errOAAI
errWang, Pichao; Li, Wanqing; Li, Chuankun; Hou, Yonghong
err分享
err收藏
Action Recognition Using 3D Histograms of Texture and A Multi-Class Boosting Classifier
err2017-10-01
err135
errOAAI
errZhang, Baochang; Yang, Yun; Chen, Chen; Yang, Linlin; Han, Jungong; Shao, Ling
err分享
err收藏
学者 查看更多内容