arrow
返回

DGFormer: Dynamic graph transformer for 3D human pose estimation

delete2024-08-01
delete1
PRE
AI
Z
Zhangmeng Chen
J
J. P. Dai *
J
Junxuan Bai
J
Junjun Pan
DOI:10.1016/j.patcog.2024.110446delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Despite the significant progress for monocular 3D human pose estimation, it still faces challenges due to self- occlusions and depth ambiguities. To tackle those issues, we propose a novel Dynamic Graph Transformer (DGFormer) to exploit local and global relationships between skeleton joints for pose estimation. Specifically, the proposed DGFormer mainly consists of three core modules: Transformer Encoder (TE), immobile Graph Convolutional Network (GCN), and dynamic GCN. TE module leverages the self-attention mechanism to learn the complex global relationships among skeleton joints. The immobile GCN is responsible for capturing the local physical connections between human joints, while the dynamic GCN concentrates on learning the sparse dynamic K-nearest neighbor interactions according to different action poses. By building the adequately global long-range, local physical, and sparse dynamic dependencies of human joints, experiments on Human3.6M and MPI-INF-3DHP datasets demonstrate that our method can predict 3D pose with lower errors outperforming the recent state-of-the-art image-based performance. Furthermore, experiments on in- the-wild videos demonstrate the impressive generalization abilities of our method. Code will be available at: https://github.com/czmmmm/DGFormer.
Keyword:
3D human pose estimation
Transformer
Graph

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

C
Capital University of Physical Education and Sports
学者数:
650
论文数: 357
被引数: 158
B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
P
Peng Cheng Laboratory
学者数:
1.7K
论文数: 1.8K
被引数: 2.0K
学者 查看更多机构
引用论文

引用论文

Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos
err2021-01-01
err19
errOAAI
errZhang, Junhao; Wang, Yali; Zhou, Zhipeng; Luan, Tianyu; Wang, Zhe; Qiao, Yu
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Susac syndrome in a patient with human immunodeficiency virus infection
err2013-05-21
err0
errOAAI
errErin E. Longbrake; Beau M. Ances; Ryan B. Viets; David B. Clifford
err分享
err收藏
Antisense oligonucleotide targeting of insulin‐like growth factor‐1 receptor (IGF‐1R) in prostate cancer
err2009-09-29
err0
PREAI
errJunya Furukawa; Christopher J. Wraight; Susan M. Freier; Eigan Peralta; Lynne M. Atley; Brett P. Monia; Martin E. Gleave; Michael E. Cox
err分享
err收藏
err分享
err收藏
学者 查看更多内容