arrow
返回

HeadDiff: Exploring Rotation Uncertainty With Diffusion Models for Head Pose Estimation

delete2024-01-01
delete1
PRE
AI
Y
Yaoxing Wang
H
Hao Liu *
Y
Yaowei Feng
Z
Zhendong Li
武
武向娟 (Xiangjuan Wu)
C
Congcong Zhu
DOI:10.1109/TIP.2024.3372457delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose a probabilistic regression diffusion model for head pose estimation, dubbed HeadDiff, which typically addresses the rotation uncertainty, especially when faces are captured in wild conditions. Unlike conventional image-to-pose methods which cannot explicitly establish the rotational manifold of head poses, our HeadDiff aims to ensure the pose rotation via the diffusion process and in parallel, refine the mapping process iteratively. Specifically, we initially formulate the head pose estimation problem as a reverse diffusion process, defining a paradigm for progressive denoising on the manifold, which explores the uncertainty by decomposing the large gap into intermediate steps. Moreover, our HeadDiff is equipped with an isotropic Gaussian distribution by encoding the incoherence information in our rotation representation. Finally, we learn the facial relationship of nearest neighbors with a cycle-consistent constraint for robust pose estimation versus diverse shape variations. Experimental results on multiple datasets demonstrate that our proposed method outperforms existing state-of-the-art techniques without auxiliary data.
Keyword:
Pose estimation
Solid modeling
Manifolds
Uncertainty
Three-dimensional displays
Faces
Rotation measurement
Head pose estimation
diffusion model
structural learning
biometrics

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
Ningxia University
学者数:
7.9K
论文数: 5.1K
被引数: 6.6K
U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
引用论文

引用论文

err分享
err收藏
Deep Bingham Networks: Dealing with Uncertainty and Ambiguity in Pose Estimation
err2022-05-04
err10
PREAI
errDeng, Haowen; Bui, Mai; Navab, Nassir; Guibas, Leonidas; Ilic, Slobodan; Birdal, Tolga
err分享
err收藏
Induction of hypervascularity without leakage or inflammation in transgenic mice overexpressing hypoxia-inducible factor-1α
err2001-10-01
err0
errOAAI
errDavid A. Elson; Gavin Thurston; L. Eric Huang; David G. Ginzinger; Donald M. McDonald; Randall S. Johnson; Jeffrey M. Arbeit
err分享
err收藏
QuatNet: Quaternion-Based Head Pose Estimation With Multiregression Loss
err2019-04-01
err111
PREAI
errHsu, Heng-Wei; Wu, Tung-Yu; Wan, Sheng; Wong, Wing Hung; Lee, Chen-Yi
err分享
err收藏
European molecular epidemiology and strain diversity of feline calicivirus
err2016-01-30
err0
errOAAI
errJ. Hou; F. Sánchez‐Vizcaíno; D. McGahie; C. Lesbros; T. Almeras; D. Howarth; V. O'Hara; S. Dawson; A. D. Radford
err分享
err收藏
Thalamocortical Long-Term Potentiation Becomes Gated after the Early Critical Period in the Auditory Cortex
err2013-04-24
err0
errOAAI
errSungkun Chun; Ildar T. Bayazitov; Jay A. Blundon; Stanislav S. Zakharenko
err分享
err收藏
学者 查看更多内容