arrow
返回

Multi-label, multi-task CNN approach for context-based emotion recognition

delete2021-12-01
delete34
PRE
AI
I
Ilyes Bendjoudi *
F
Frédéric Vanderhaegen
D
Denis Hamad
F
Fadi Dornaika
DOI:10.1016/j.inffus.2020.11.007delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes a new deep learning architecture for context-based multi-label multi-task emotion recognition. The architecture is built from three main modules: (1) a body features extraction module, which is a pre-trained Xception network, (2) a scene features extraction module, based on a modified VGG16 network, and (3) a fusion-decision module. Moreover, three categorical and three continuous loss functions are compared in order to point out the importance of the synergy between loss functions when it comes to multi-task learning. Then, we propose a new loss function, the multi-label focal loss (MFL), based on the focal loss to deal with imbalanced data. Experimental results on EMOTIC dataset show that MFL with the Huber loss gave better results than any other combination and outperformed the current state of art on the less frequent labels.
Keyword:
Emotion recognition
Loss function
Multi-task machine learning
Deep learning
Unbalanced data
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Information Fusion 封面图
Information Fusion
IF:
15.5
论文数:
4.2K
被引数:
2.7W

机构

C
centre national de la recherche scientifique (cnrs)
学者数:
24.5W
论文数: 18.2W
被引数: 279
U
universite polytechnique hauts-de-france
学者数:
1.3K
论文数: 1.1K
被引数: 0
U
universite du littoral-cote-d'opale
学者数:
1.1K
论文数: 799
被引数: 1
学者 查看更多机构
引用论文

引用论文

Comparative analysis between RQ‐PCR and digital droplet PCR of BCL2/IGH gene rearrangement in the peripheral blood and bone marrow of early stage follicular lymphoma
err2017-04-17
err0
errOAAI
errMarzia Cavalli; Lucia Anna De Novi; Irene Della Starza; Luca Vincenzo Cappelli; Vittorio Nunes; Alessandro Pulsoni; Ilaria Del Giudice; Anna Guarini; Robin Foà
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Power Electronic Converters
err
IF0
err2017-10-12
err0
PREAI
errTeuvo Suntio; Tuomas Messo; Joonas Puukko
err分享
err收藏
Matrixlysis, an improved sample preparation method for recovery of Mycobacteria from animal tissue material
err2017-07-19
err0
errOAAI
errChristoph Leth; Ashok Varadharajan; Patrick Mester; Marlis Fischaleck; Peter Rossmanith; Friedrich Schmoll; Maria Fink
err分享
err收藏
err分享
err收藏
Affinity-Bead Assisted Mass Spectrometry (Affi-BAMS): A Multiplexed Microarray Platform for Targeted Proteomics
err2020-03-16
err0
errOAAI
errGhaith M. Hamza; Vladislav B. Bergo; Sergey Mamaev; Don M. Wojchowski; Paul Toran; Camilla R. Worsfold; M. Paola Castaldi; Jeffrey C. Silva
err分享
err收藏
Facial and vocal expressions of emotion
err2003-02-01
err586
PREAI
errRussell, JA; Bachorowski, JA; Fernández-Dols, JM
err分享
err收藏
学者 查看更多内容