.png){kind=icon}
返回
Facial Action Unit Detection Using Attention and Relation Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TAFFC.2019.2948635.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most of the existing attention based AU detection works use prior knowledge to predefine fixed attentions or refine the predefined attentions within a small range, which limits their capacity to model various AUs. In this paper, we propose an end-to-end deep learning based attention and relation learning framework for AU detection with only AU labels, which has not been explored before. In particular, multi-scale features shared by each AU are learned first, and then both channel-wise and spatial attentions are adaptively learned to select and extract AU-related local features. Moreover, pixel-level relations for AUs are further captured to refine spatial attentions so as to extract more relevant local features. Without changing the network architecture, our framework can be easily extended for AU intensity estimation. Extensive experiments show that our framework (i) soundly outperforms the state-of-the-art methods for both AU detection and AU intensity estimation on the challenging BP4D, DISFA, FERA 2015, and BP4D+ benchmarks, (ii) can adaptively capture the correlated regions of each AU, and (iii) also works well under severe occlusions and large poses.
Keyword:
Gold
Feature extraction
Estimation
Face
Deep learning
Computer science
Learning systems
Channel-wise and spatial attention learning
pixel-level relation learning
facial AU detection
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
.png){kind=icon}
分享收藏分享收藏BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression databaseBP4D-Spontaneous: 高分辨率自发三维动态面部表情数据库
PREAI
分享收藏
查看更多内容