arrow
Return

Hierarchical adaptive multi-scale hypergraph attention convolution network for skeleton-based action recognition

delete2025-03-01
delete0
PRE
AI
H
Honghong Yang
S
Sai Wang
L
Lu Jiang
Y
Yumei Zhang *
DOI:10.1016/j.asoc.2025.112855delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Graph Convolutional Networks (GCN) have been widely used for skeleton-based human action recognition (HAR). However, the inherent graph topology design strategy and equally treated the spatial and temporal information in feature aggregation are two main problems existed in GCN-based skeleton HAR. To effectively address those issues, a hierarchical adaptive multi-scale hypergraph attention convolution network (HAMHGNet) is proposed in our work. Firstly, a hierarchical adaptive clustering partition module is formulated to construct dynamic graph topology for inferring the joint- to parts -to group interaction according their movements in different actions. Then, a multi-scale hypergraph attention convolution module is designed to relax the restriction of the fixed topology, maintaining the inherent spatial characteristic of the skeleton joints. Finally, a temporal segmentation attention constrained encoding module is constructed to model the relationship between different joints in several consecutive frames. Experimental results on two benchmark datasets, i.e. NTU-RGB+D 60 (93.1 % on X-View and 96.7 % on X-Sub) and NTU-RGB+D 120 (90.1 % on X-Sub and 90.8 % on X-Set), validate the proposed model can achieve the state-of-the-art performance for skeleton-based action recognition.
Keywords:
Action recognition
Multi-scale hypergraph attention convolution
Hierarchical adaptive clustering
Dynamic graph topology

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

No organization information available
Cited Papers

Cited Papers

Spatio-temporal segments attention for skeleton-based action recognition
err2023-01-01
err21
PREAI
errQiu, Helei; Hou, Biao; Ren, Bo; Zhang, Xiaohua
errShare
errSave
Hierarchical graph attention network with pseudo-metapath for skeleton-based action recognition
err2022-08-01
err7
PREAI
errWang, Mingdao; Li, XueMing; Zhang, Xianlin; Zhang, Yue
errShare
errSave
errShare
errSave
Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
err2018-04-01
err423
errOAAI
errLiu, Jun; Wang, Gang; Duan, Ling-Yu; Abdiyeva, Kamila; Kot, Alex C.
errShare
errSave
Joint-Bone Fusion Graph Convolutional Network for Semi-Supervised Skeleton Action Recognition
err2023-01-01
err54
errOAAI
errTu, Zhigang; Zhang, Jiaxu; Li, Hongyan; Chen, Yujin; Yuan, Junsong
errShare
errSave
Hypergraph convolution and hypergraph attention
err2021-02-01
err333
errOAAI
errBai, Song; Zhang, Feihu; Torr, Philip H. S.
errShare
errSave
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
err2020-10-01
err0
errOAAI
errJun Liu; Amir Shahroudy; Mauricio Perez; Gang Wang; Ling-Yu Duan; Alex C. Kot
errShare
errSave
errShare
errSave
researcher View more