返回
Dimensional Affect Uncertainty Modelling for Apparent Personality Recognition
DOI:10.1109/TAFFC.2022.3189974.png)
摘要
En 中文
Despite achieving impressive performance, dimensional affect or emotion recognition from faces is largely based on uncertainty-unaware models that predict only point estimates. Modelling uncertainty is important to learn reliable facial emotion recognition models with the abilities to (a). holistically quantify predictive uncertainty estimates and (b). propagate those estimates to the benefit of downstream behavioural analysis tasks. In this work, we first quantify uncertainties in dimensional emotion recognition by adopting the framework of epistemic (model) and aleatoric (data) uncertainty categorisation. Then for evaluating the practical utility of uncertainty-aware emotion predictions, we introduce them in learning an important downstream task, apparent personality recognition. To this end, we ask two questions: how to effectively (a). use already known behavioural attributes (emotions) in a downstream task (personality recognition) and (b). summarise global temporal context from uncertainty-aware emotion predictions fused with image embeddings. Answering these questions, we learn a conditional latent variable model building on recently proposed neural latent variable models. Our experiments on two in-the-wild datasets, SEWA for emotion recognition and ChaLearn for personality recognition, demonstrate that fusion of epistemic and aleatoric emotion uncertainties significantly improves personality recognition performance, with similar to 42% relative improvement in Pearson correlation coefficient, leading to a new state-of-the-art.
Keyword:
Emotion recognition
epistemic and aleaotoric uncertainty
personality recognition
uncertainty modelling
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
CR-Net: A Deep Classification-Regression Network for Multimodal Apparent Personality AnalysisCr-net: 用于多模态表观人格分析的深度分类-回归网络
Modeling of electrodialytic and dialytic removal of Cr, Cu and As from CCA-treated wood chips
Chemosphere
IF0

