arrow
返回

Dynamic spatial-temporal topology graph network for skeleton-based action recognition

delete2024-10-29
delete0
PRE
AI
C
Chen Lian
K
Ke Lü
Z
Zehai Niu
R
Runchen Wei
J
Jian Xue *
DOI:10.1007/s00530-024-01531-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Over the past few years, skeleton-based action recognition has gained significant attention for its simple yet robust representation of the human body structure. Many researchers have employed Graph Convolutional Network (GCN) to explore discriminative features of skeletons, achieving notable success. Nevertheless, conventional GCNs may be unable to efficiently capture joint dependencies in spatial-temporal dimensions due to their shared topology for different frames and channels, which are crucial for action understanding. To address this issue, we propose a Dynamic Spatial-Temporal Topology Graph Network (DST-GNet), which generates distinct topologies for different frames and channels, exploring abundant joint correlations of action sequences. Specifically, a data-driven Temporal Topology Matrix Learning (TTML) module is designed to capture intrinsic body correlations in each frame, boosting the model's generalization and flexibility. A Temporal-Specific Aggregation (TSA) module is also proposed for temporal-specific feature aggregation. Furthermore, we introduce an optimized Multi-Level Temporal Aggregation (MLTA) module to aggregate motion information along the temporal dimension, reducing the model complexity significantly. Experimental results demonstrate that our DST-GNet achieves comparable performance on three large-scale 3D human action datasets: NTU-RGB+D, NTU-RGB+D 120 and Northwestern-UCLA.
Keyword:
3D skeleton-based action recognition
Graph convolutional network
Spatial-temporal feature
Graph inference

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Pretransplant Culture Selects for High-quality Porcine Islets
err2006-05-01
err0
PREAI
errJosephine K.R.A. Rijkelijkhuizen; Michael P.M. van der Burg; Annemiek Töns; Onno T. Terpstra; Eelco Bouwman
err分享
err收藏
Positioning strictureplasty in the treatment of extensive Crohn’s disease ileitis: a comparative study with ileocecal resection
err2021-01-22
err0
PREAI
errGabriele Bislenghi; Steffen Fieuws; Albert Wolthuis; Dirk Vanbeckevoort; Marc Ferrante; Joao Sabino; Severine Vermeire; André D’Hoore
err分享
err收藏
err分享
err收藏
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
err2002-01-01
err0
PREAI
errD. I. Ismailov; E. Sh. Alekperov; F. I. Aliev
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
学者 查看更多内容