arrow
Return

Diffusion model with temporal constraint for 3D human pose estimation

delete2024-12-26
delete0
PRE
AI
Z
Zhangmeng Chen
J
J. P. Dai *
J
Junjun Pan *
F
Feng Zhou
DOI:10.1007/s00371-024-03763-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
3D human pose estimation has received increasing attention as it is the foundation for many downstream tasks. However, this task is challenging due to inherent depth ambiguity and occlusion issues. Thanks to the ability of diffusion models to generate multiple hypotheses, they are promising in reducing uncertainty in results. Inspired by this, we propose a diffusion-based temporal constraint framework for 3D human pose estimation, called DTCPose, which generates multiple 3D candidate poses with 2D poses as conditions to synthesize the final pose to improve estimation accuracy. Simultaneously, to ensure the temporal stability of the 3D output sequences, we introduce temporal constraints into the model to reduce the jitter of the results. Extensive experiments on Human3.6M and MPI-INF3DHP datasets demonstrate that our approach performs predominantly in both single-hypothesis and multi-hypothesis 3D human pose estimation. Code will be available at: https://github.com/czmmmm/DCTPose.
Keywords:
Diffusion model
Temporal constraint
3D human pose estimation

Journal

Visual Computer cover
Visual Computer
IF:
2.9
Papers:
4.6K
Citations:
6.5K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
N
North China University of Technology
Scholars:
2.0K
Papers: 1.6K
Citations: 962
P
Peng Cheng Laboratory
Scholars:
1.7K
Papers: 1.8K
Citations: 2.0K
researcher View more organizations
Cited Papers

Cited Papers

MicroRNA-23a expression in paraffin-embedded specimen correlates with overall survival of diffuse large B-cell lymphoma
err2014-03-22
err0
PREAI
errWan-ling Wang; Cui Yang; Xiao-lin Han; Ran Wang; Yan Huang; You-mei Zi; Jing-dong Li
errShare
errSave
Impact of vision impairment and self-reported barriers to vision care: The views of elders in Nuwara Eliya district, Sri Lanka
err2016-10-19
err0
errOAAI
errW. Holmes; R. Shajehan; S. Kitnasamy; C. Abeywickrama; Y. Arsath; F. Gnanaraj; S. Inbaraj; G. Jayakody; K. Durrant; S. Luchters
errShare
errSave
Sex hormones secondary players in Susac's syndrome
err2020-09-01
err0
PREAI
errAnca Loredana Alungulese; Miguel Ángel García Soldevilla; Diego Barragán Martínez; Ricardo Gordo Mañas
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Diversity and productivity of plant communities across the Inland Northwest, USA
err2005-03-24
err0
PREAI
errMichael D. Jennings; John W. Williams; Mark R. Stromberg
errShare
errSave
errShare
errSave
Exploiting Temporal Contexts With Strided Transformer for 3D Human Pose Estimation
err2023-01-01
err84
errOAAI
errLi, Wenhao; Liu, Hong; Ding, Runwei; Liu, Mengyuan; Wang, Pichao; Yang, Wenming
errShare
errSave
researcher View more