arrow
返回

Dimensional Affect Uncertainty Modelling for Apparent Personality Recognition

delete2022-10-01
delete6
PRE
AI
M
Mani Kumar Tellamekala *
T
Timo Giesbrecht
M
Michel Valstar
DOI:10.1109/TAFFC.2022.3189974delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Despite achieving impressive performance, dimensional affect or emotion recognition from faces is largely based on uncertainty-unaware models that predict only point estimates. Modelling uncertainty is important to learn reliable facial emotion recognition models with the abilities to (a). holistically quantify predictive uncertainty estimates and (b). propagate those estimates to the benefit of downstream behavioural analysis tasks. In this work, we first quantify uncertainties in dimensional emotion recognition by adopting the framework of epistemic (model) and aleatoric (data) uncertainty categorisation. Then for evaluating the practical utility of uncertainty-aware emotion predictions, we introduce them in learning an important downstream task, apparent personality recognition. To this end, we ask two questions: how to effectively (a). use already known behavioural attributes (emotions) in a downstream task (personality recognition) and (b). summarise global temporal context from uncertainty-aware emotion predictions fused with image embeddings. Answering these questions, we learn a conditional latent variable model building on recently proposed neural latent variable models. Our experiments on two in-the-wild datasets, SEWA for emotion recognition and ChaLearn for personality recognition, demonstrate that fusion of epistemic and aleatoric emotion uncertainties significantly improves personality recognition performance, with similar to 42% relative improvement in Pearson correlation coefficient, leading to a new state-of-the-art.
Keyword:
Emotion recognition
epistemic and aleaotoric uncertainty
personality recognition
uncertainty modelling

期刊

IEEE Transactions on Affective Computing 封面图
IEEE Transactions on Affective Computing
IF:
9.8
论文数:
1.4K
被引数:
9.1K

机构

U
Unilever
学者数:
2.3K
论文数: 1.8K
被引数: 2
U
University of Nottingham
学者数:
3.4W
论文数: 3.2W
被引数: 5.5W
引用论文

引用论文

Differences and Similarities in Insular and Temporal Pole MRI Gray Matter Volume Abnormalities in First-Episode Schizophrenia and Affective Psychosis
err2003-11-01
err0
errOAAI
errKiyoto Kasai; Martha E. Shenton; Dean F. Salisbury; Toshiaki Onitsuka; Sarah K. Toner; Deborah Yurgelun-Todd; Ron Kikinis; Ferenc A. Jolesz; Robert W. McCarley
err分享
err收藏
err分享
err收藏
Characteristics of upper urinary tract urothelial carcinoma in the context of bladder cancer: a narrative review
err2021-10-01
err0
errOAAI
errNicola Giudici; Fieke Bonne; Jennifer Blarer; Martina Minoli; Friedemann Krentel; Roland Seiler
err分享
err收藏
Proliferative activity is disturbed in myeloproliferative neoplasms (MPN), myelodysplastic syndrome (MDS), and MDS/MPN diseases. Differences between MDS and MDS/MPN
err2020-08-28
err0
errOAAI
errStefan G. C. Mestrum; Norbert C. J. de Wit; Roosmarie J. M. Drent; Anton H. N. Hopman; Frans C. S. Ramaekers; Math P. G. Leers
err分享
err收藏
err分享
err收藏
Modeling, Recognizing, and Explaining Apparent Personality From Videos从视频中建模,识别和解释明显的个性
err2022-04-01
err35
errOAAI
errJair Escalante, Hugo; Kaya, Heysem; Salah, Albert Ali; Escalera, Sergio; Gucluturk, Yagmur; Guclu, Umut; Baro, Xavier; Guyon, Isabelle; Jacques, Julio C. S., Jr.; Madadi, Meysam; Ayache, Stephane; Viegas, Evelyne; Gurpinar, Furkan; Wicaksana, Achmadnoer Sukma; Liem, Cynthia C. S.; van Gerven, Marcel A. J.; van Lier, Rob
err分享
err收藏
Modeling of electrodialytic and dialytic removal of Cr, Cu and As from CCA-treated wood chips
err2007-01-01
err0
PREAI
errA.B. Ribeiro; J.M. Rodríguez-Maroto; E.P. Mateus; E. Velizarova; L.M. Ottosen
err分享
err收藏
学者 查看更多内容