.png){kind=icon}
返回
Domain-Consistent and Uncertainty-Aware Network for Generalizable Gaze Estimation
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2024.3358948.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unsupervised domain adaptive (UDA) gaze estimation aims to predict gaze directions of unlabeled target face or eye images given a set of annotated source images, which has been widely applied in practical applications. However, existing methods still perform poorly due to two major challenges. 1) There exists large personalized differences and style discrepancies between source and target samples, which leads the learned source model easily collapsing to biased results. 2) Data uncertainties inherent in reference samples will affect the generalization ability of their models. To tackle the above challenges, in this paper, we propose a novel Domain-Consistent and Uncertainty-Aware (DCUA) network for generalizable gaze estimation. Our DCUA network employs a two-phase framework where a primary training sub-network (PTNet) and a refined adaptation sub-network (RANet) are trained on the source and target domain, respectively. Firstly, to obtain robust and pure gaze-related features, we propose twain domain consistent constraints, that is, the intra-domain consistent constraint and the inter-domain consistent constraint. These two constraints could eliminate the impact of gaze-irrelevant factors by maintaining consistency between label and feature space. Secondly, to further improve the adaptability of our model, we propose dual uncertainty perception modules, which include an intrinsic uncertainty module and an extrinsic uncertainty module. These modules help DCUA network distinguish inferior reference samples and avoid overfitting to them. Experiments on four cross-domain gaze estimation tasks demonstrate the effectiveness of our method.
Keyword:
Gaze estimation
domain adaptation
uncertainty learning
unsupervised learning
期刊
IF:
9.7
论文数:
4.7K
被引数:
2.4W
机构
引用论文
Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation通过不确定性估计纠正伪标签学习，用于领域自适应语义分割
PREAI
分享收藏
A New, Remarkably Colorful, Small Ricefish of the Genus Oryzias (Beloniformes, Adrianichthyidae) from Sulawesi, Indonesia.png)
Copeia
CopeiaIF0
PREAI
分享收藏Fully integrated cmos resonant cantilever sensor for bio-chemical detection in liquid environments
PREAI
分享收藏
查看更多内容