arrow
返回

Improved skeleton-based activity recognition using convolutional block attention module

delete2024-05-01
delete2
PRE
AI
秦
秦进 (Jing Qin)
S
Shugang Zhang
Y
Yiguo Wang
F
Fei Yang
X
Xin Zhong
W
Weigang Lu *
DOI:10.1016/j.compeleceng.2024.109231delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Inferring human activities from the skeletons extracted from activity photos or videos is a fundamental yet important issue in the research community of computer vision. Current skeletonbased activity recognition methods have accomplished this task by extracting features in either spatial or temporal perspective, or combining both views; however, the extracted features lack further after -processing like feature augmentation. Aiming at the above shortcomings, this article presents a new human activity recognition approach based on human skeleton data, named Convolutional Block Attention Module -based Spatial Temporal Convolutional Network (CBAMSTGCN). To enhance the discriminative validity of the generated features, we leverage the attention mechanism to weight feature units within each dimension by introducing two attention modules designed in terms of different aspects into the model architecture. Specifically, the original feature map of an activity sample is adaptively refined by the convolutional block attention module, where two separate attention maps obtained with regard to spatial and channel dimensions are adopted to generate the corresponding attended feature maps. Evaluation results on the Kinetics benchmark dataset showed that the proposed model has improved 1.76 % and 2.43 % according to top -1 and top -5 metrics, respectively, compared to the conventional baseline model. Further ablation experiments proved that both channel and spatial attention modules contribute to the model performance.
Keyword:
Activity recognition
Deep learning
Attention
Graph convolutional network
Skeleton

期刊

C
Computers and Electrical Engineering
IF:
4.9
论文数:
6.7K
被引数:
1.3W

机构

O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

Wireless respiratory monitoring and coughing detection using a wearable patch sensor network
err2017-06-01
err0
PREAI
errTamer Elfaramawy; Cheikh Latyr Fall; Martin Morissette; Francois Lellouche; Benoit Gosselin
err分享
err收藏
Skeleton-based human activity recognition using ConvLSTM and guided feature learning
err2021-10-01
err43
errOAAI
errYadav, Santosh Kumar; Tiwari, Kamlesh; Pandey, Hari Mohan; Akbar, Shaik Ali
err分享
err收藏
Vision-based human activity recognition: a survey基于视觉的人类活动识别研究综述
err2020-08-15
err258
errOAAI
errBeddiar, Djamila Romaissa; Nini, Brahim; Sabokrou, Mohammad; Hadid, Abdenour
err分享
err收藏
Oxidation - Nitridation of Ni-Cr-Al alloys
err2004-03-01
err0
errOAAI
errSusan Han; David John Young
err分享
err收藏
err分享
err收藏
学者 查看更多内容