arrow
返回

Multimodal learning for facial expression recognition

delete2015-10-01
delete95
PRE
AI
W
Wei Zhang
张
张友梅 (Youmei Zhang)
L
Lin Ma *
关婧玮 封面图
关婧玮 (Jingwei Guan)
DOI:10.1016/j.patcog.2015.04.012delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, multimodal learning for facial expression recognition (FER) is proposed. The multimodal learning method makes the first attempt to learn the joint representation by considering the texture and landmark modality of facial images, which are complementary with each other. In order to learn the representation of each modality and the correlation and interaction between different modalities, the structured regularization (SR) is employed to enforce and learn the modality-specific sparsity and density of each modality, respectively. By introducing SR, the comprehensiveness of the facial expression is fully taken into consideration, which can not only handle the subtle expression but also perform robustly to different input of facial images. With the proposed multimodal learning network, the joint representation learning from multimodal inputs will be more suitable for FER. Experimental results on the CK+ and NVIE databases demonstrate the superiority of our proposed method. (C) 2015 Elsevier Ltd. All rights reserved.
Keyword:
Multimodal learning
Facial expression recognition
Texture
Landmark
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Learning spatiotemporal features by using independent component analysis with application to facial expression recognition
err2012-09-01
err40
PREAI
errLong, Fei; Wu, Tingfan; Movellan, Javier R.; Bartlett, Marian S.; Littlewort, Gwen
err分享
err收藏
An Outphase-Interleaved Switched-Capacitor Hybrid Buck Converter With Relieved Capacitor Inrush Current and COUT-Free Operations
err2024-04-01
err0
PREAI
errXiongjie Zhang; Qiaobo Ma; Yang Jiang; Anyang Zhao; Man-Kay Law; Rui P. Martins; Pui-In Mak
err分享
err收藏
Elimination of permeability mutants from selections for drug resistance in mammalian cells
err1989-02-01
err0
PREAI
errMatthew J. Schibler; Steven B. Barlow; Fernando Cabral
err分享
err收藏
Plasma interleukin-6 and executive function in crack cocaine-dependent women
err2016-08-01
err0
PREAI
errMateus Luz Levandowski; Adriana Raquel Binsfeld Hess; Rodrigo Grassi-Oliveira; Rosa Maria Martins de Almeida
err分享
err收藏
学者 查看更多内容