arrow
返回

Uncertain Facial Expression Recognition via Multi-Task Assisted Correction

delete2024-01-01
delete4
delete
OA
AI
Y
Yang Liu
X
Xingming Zhang
J
Janne Kauttonen
G
Guoying Zhao *
DOI:10.1109/TMM.2023.3301209delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep models for facial expression recognition achieve high performance by training on large-scale labeled data. However, publicly available datasets contain uncertain facial expressions caused by ambiguous annotations or confusing emotions, which could severely decline the robustness. Previous studies usually follow the bias elimination method in general tasks without considering the uncertainty problem from the perspective of different corresponding sources. This article proposes a novel method of multi-task assisted correction in addressing uncertain facial expression recognition called MTAC. Specifically, a confidence estimation block and a weighted regularization module are applied to highlight solid samples and suppress uncertain samples in every batch. In addition, two auxiliary tasks, i.e., action unit detection and valence-arousal measurement, are introduced to learn semantic distributions from a data-driven AU graph and mitigate category imbalance based on latent dependencies between discrete and continuous emotions, respectively. Moreover, a re-labeling strategy guided by feature-level similarity constraint further generates new labels for identified uncertain samples to promote model learning. The proposed method can flexibly combine with existing frameworks in a fully-supervised or weakly-supervised manner. Experiments on five popular benchmarks demonstrate that the MTAC substantially improves over baselines when facing synthetic and real uncertainties and outperforms the state-of-the-art methods.
Keyword:
Facial expression recognition
uncertainty
action unit
valence
arousal
multi-task learning

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
University of Oulu
学者数:
1.5W
论文数: 1.3W
被引数: 1.6W
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Grain Boundary Assemblies in Dynamically-Recrystallized Austenitic Stainless Steel
err2016-11-07
err0
errOAAI
errMarina Tikhonova; Pavel Dolzhenko; Rustam Kaibyshev; Andrey Belyakov
err分享
err收藏
Around-the-horn PCR and cloning v1
err
IF0
err2018-07-03
err0
PREAI
errStephen Floor
err分享
err收藏
An investigation on the role of 5‐hydroxytryptophan in the biosynthesis of melanins
err2002-12-17
err0
PREAI
errSusanna Vogliardi; Graziella Allegri; Antonella Bertazzo; Carlo V. L. Costa; Roberta Seraglia; Pietro Traldi
err分享
err收藏
End-to-End Multimodal Emotion Recognition Using Deep Neural Networks基于深度神经网络的端到端多模态情感识别
err2017-12-01
err375
errOAAI
errTzirakis, Panagiotis; Trigeorgis, George; Nicolaou, Mihalis A.; Schuller, Bjorn W.; Zafeiriou, Stefanos
err分享
err收藏
err分享
err收藏
学者 查看更多内容