arrow
返回

Spatial-Temporal Dynamic Graph Attention Network for Skeleton-Based Action Recognition

delete2023-01-01
delete16
delete
OA
AI
M
Mrugendrasinh Rahevar
A
Amit Ganatra
T
Tanzila Saba
A
Amjad Rehman
S
Saeed Ali Bahaj *
DOI:10.1109/ACCESS.2023.3247820delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Human body skeleton, acting as a spatiotemporal graph, is increasing attentions of researchers to adopt graph convolutional networks (GCN) to mine the discriminative features from skeleton joints. However, one of GCN's flaws is its inability to handle long-distance reliance between joints. In this regard, graph attention network (GAT) was recently suggested, which combines graph convolutions with a self-attention mechanism to extract the most informative joint of a human skeleton and increase the model accuracy. However, GAT can compute only static attention: for each query node, the attention rank is same which severely hurts and limits the expressivity of an attention mechanism. In this work, we present a spatial-temporal dynamic graph attention network (ST-DGAT) to learn the spatial-temporal patterns of skeleton sequences. For dynamic graph attention, we tweak the order of weighted vector operations in GAT, our approach achieves a global approximate attention function, making it strictly superior to GAT. Experiments show that by fixing the order of internal operation of GAT the proposed model achieved better action classification results while maintaining the same computing cost as GAT. The proposed framework has been evaluated on well-known publicly available large-scale datasets NTU60, NTU120, and Kinetics-400, which notably outperforms state-of-the-art (SOTA) results with an accuracy of 96.4%, 88.2%, and 61.0%, respectively.
Keyword:
Computational modeling
Spatiotemporal phenomena
Feature extraction
Convolutional neural networks
Computer architecture
Skeleton
action recognition
graph attention network
multihead attention

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

P
Prince Sultan University
学者数:
1.9K
论文数: 2.3K
被引数: 2.3K
P
Parul University
学者数:
1.4K
论文数: 936
被引数: 675
C
charotar university of science & technology - charusat
学者数:
904
论文数: 621
被引数: 3
P
Prince Sattam Bin Abdulaziz University
学者数:
6.9K
论文数: 8.9K
被引数: 9.9K
学者 查看更多机构
引用论文

引用论文

Pretransplant Culture Selects for High-quality Porcine Islets
err2006-05-01
err0
PREAI
errJosephine K.R.A. Rijkelijkhuizen; Michael P.M. van der Burg; Annemiek Töns; Onno T. Terpstra; Eelco Bouwman
err分享
err收藏
err分享
err收藏
Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
The vegetation of a New Zealand dune slack
err1987-07-01
err0
PREAI
errMartin T. Sykes; J. Bastow Wilson
err分享
err收藏
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
Climate policy: Steps to China's carbon peak气候政策: 迈向中国碳峰值的步骤
err2015-06-17
err0
errOAAI
errZhu Liu; Dabo Guan; Scott Moore; Henry Lee; Jun Su; Qiang Zhang
err分享
err收藏
Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
err2018-04-01
err423
errOAAI
errLiu, Jun; Wang, Gang; Duan, Ling-Yu; Abdiyeva, Kamila; Kot, Alex C.
err分享
err收藏
学者 查看更多内容