arrow
返回

Facial action unit recognition under incomplete data based on multi-label learning with missing labels

delete2016-12-01
delete28
PRE
AI
Y
Yongqiang Li
B
Baoyuan Wu *
B
Bernard Ghanem
赵
赵永平 (Yong-Ping Zhao)
H
Hongxun Yao
Q
Qiang Ji
DOI:10.1016/j.patcog.2016.07.009delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Facial action unit (AU) recognition has been applied in a wild range of fields, and has attracted great attention in the past two decades. Most existing works on AU recognition assumed that the complete label assignment for each training image is available, which is often not the case in practice. Labeling AU is expensive and time consuming process. Moreover, due to the AU ambiguity and subjective difference, some AUs are difficult to label reliably and confidently. Many AU recognition works try to train the classifier for each AU independently, which is of high computation cost and ignores the dependency among different AUs. In this work, we formulate AU recognition under incomplete data as a multi-label learning with missing labels (MLML) problem. Most existing MLML methods usually employ the same features for all classes. However, we find this setting is unreasonable in AU recognition, as the occurrence of different AUs produce changes of skin surface displacement or face appearance in different face regions. If using the shared features for all AUs, much noise will be involved due to the occurrence of other AUs. Consequently, the changes of the specific AUs cannot be clearly highlighted, leading to the performance degradation. Instead, we propose to extract the most discriminative features for each AU individually, which are learned by the supervised learning method. The learned features are further embedded into the instance-level label smoothness term of our model, which also includes the label consistency and the class-level label smoothness. Both a global solution using st-cut and an approximated solution using conjugate gradient (CG) descent are provided. Experiments on both posed and spontaneous facial expression databases demonstrate the superiority of the proposed method in comparison with several state-of-the-art works. (C) 2016 Elsevier Ltd. All rights reserved.
Keyword:
Face action unit recognition
Incomplete data
Multi-label learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
K
king abdullah university of science & technology
学者数:
1.3W
论文数: 1.3W
被引数: 32
R
rensselaer polytechnic institute
学者数:
7.0K
论文数: 6.5K
被引数: 6
学者 查看更多机构
引用论文

引用论文

Power Electronic Converters
err
IF0
err2017-10-12
err0
PREAI
errTeuvo Suntio; Tuomas Messo; Joonas Puukko
err分享
err收藏
Canine Distemper in an Isolated Population of Fishers (Martes pennanti) from California
err2012-10-01
err0
errOAAI
errStefan M. Keller; Mourad Gabriel; Karen A. Terio; Edward J. Dubovi; Elizabeth VanWormer; Rick Sweitzer; Reginald Barret; Craig Thompson; Kathryn Purcell; Linda Munson
err分享
err收藏
Catecholamine cell groups of the cat medulla oblongata
err1980-06-01
err0
PREAI
errW.W. Blessing; P. Frost; J.B. Furness
err分享
err收藏
err分享
err收藏
Learning multi-label scene classification学习多标签场景分类
err2004-09-01
err2.0K
PREAI
errBoutell, MR; Luo, JB; Shen, XP; Brown, CM
err分享
err收藏
学者 查看更多内容