.png){kind=icon}
返回
Adaptive multi-level graph convolution with contrastive learning for skeleton-based action recognition
.png){kind=icon}
PRE
AI
DOI：10.1016/j.sigpro.2022.108714.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Graph Convolutional Networks (GCNs) have been widely used in skeleton-based action recognition with remarkable achievements. Many recent studies model the human body as a topological graph and extract action features using GCNs, however, the inherent shared and static characteristics of topological graph during training limit the performance of the model. In this work, we propose an adaptive multi-level graph convolution network (AML-GCN), which uses two different levels of spatial convolution to extract spatial features and enhances the feature representation by contrastive learning, then uses multiscale temporal convolution to capture advanced temporal features. We first propose dynamic topological spa-tial graph convolution (DTSGC) using dynamic graph topology, which can be continuously updated during training and has a strong generalization ability. To further enhance flexibility of the network, we present adaptive spatial graph convolution (ASGC) using non-shared graph topology, which is unique in different layers and can extract more diverse features. Meanwhile, we introduce contrastive learning to maximize mutual information between the two modules, which are trained together to promote each other and en-hance feature representation. Extensive experiments on the three large datasets verify that the proposed model achieves excellent recognition accuracy compared to most current models.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Skeleton-based action recognition
Multi-level graph convolution network
Contrastive learning
Multi-scale temporal convolution
期刊
IF:
3.6
论文数:
9.9K
被引数:
1.7W
机构
引用论文
An improved Artificial Neural Network using Arithmetic Optimization Algorithm for damage assessment in FGM composite plates.png)
COMPOSITE STRUCTURES
COMPOSITE STRUCTURESIF7.1
PREAI
分享收藏
Enhanced skeleton visualization for view invariant human action recognition用于视图不变人体动作识别的增强骨架可视化PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容