返回
Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition
DOI:10.1016/j.patcog.2021.108275.png)
摘要
En 中文
Micro-expression recognition has become challenging, as it is extremely difficult to extract the subtle fa-cial changes of micro-expressions. Recently, several approaches have proposed various expression-shared features algorithms for micro-expression recognition. However, these approaches do not reveal the spe-cific discriminative characteristics, which leads to sub-optimal performance. This paper proposes a novel Feature Refinement (FeatRef) with expression-specific feature learning and fusion for micro-expression recognition that aims to obtain salient and discriminative features for specific expressions and predicts expressions by fusing expression-specific features. FeatRef consists of an expression proposal module with an attention mechanism and a classification branch. First, an inception module is designed based on op-tical flow to obtain expression-shared features. Second, to extract salient and discriminative features for specific expressions, expression-shared features are fed into an expression proposal module with atten-tion factors and proposal loss. Last, in the classification branch, category labels are predicted via a fusion of expression-specific features. Experiments on three publicly available databases validate the effective-ness of FeatRef under different protocols. The results on public benchmarks demonstrate that FeatRef provides salient and discriminative information for micro-expression recognition. The results also show that FeatRef achieves better or competitive performance with existing state-of-the-art methods on micro-expression recognition. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Micro-expression recognition
Deep learning
Attention mechanism
Shared feature
Feature refinement
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
NEUROCOMPUTING
IF6.5
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions用于自发微表情识别的时空循环卷积网络

