arrow
返回

Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition

delete2022-02-01
delete45
delete
OA
AI
周凌 封面图
周凌 (Ling Zhou)
Q
Qirong Mao
黄晓桦 封面图
黄晓桦 (Xiaohua Huang) *
F
Feifei Zhang
Z
Zhihong Zhang
DOI:10.1016/j.patcog.2021.108275delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Micro-expression recognition has become challenging, as it is extremely difficult to extract the subtle fa-cial changes of micro-expressions. Recently, several approaches have proposed various expression-shared features algorithms for micro-expression recognition. However, these approaches do not reveal the spe-cific discriminative characteristics, which leads to sub-optimal performance. This paper proposes a novel Feature Refinement (FeatRef) with expression-specific feature learning and fusion for micro-expression recognition that aims to obtain salient and discriminative features for specific expressions and predicts expressions by fusing expression-specific features. FeatRef consists of an expression proposal module with an attention mechanism and a classification branch. First, an inception module is designed based on op-tical flow to obtain expression-shared features. Second, to extract salient and discriminative features for specific expressions, expression-shared features are fed into an expression proposal module with atten-tion factors and proposal loss. Last, in the classification branch, category labels are predicted via a fusion of expression-specific features. Experiments on three publicly available databases validate the effective-ness of FeatRef under different protocols. The results on public benchmarks demonstrate that FeatRef provides salient and discriminative information for micro-expression recognition. The results also show that FeatRef achieves better or competitive performance with existing state-of-the-art methods on micro-expression recognition. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Micro-expression recognition
Deep learning
Attention mechanism
Shared feature
Feature refinement
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

J
Jiangsu University
学者数:
4.0W
论文数: 2.8W
被引数: 5.5W
I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
N
Nanjing Institute of Technology
学者数:
2.4K
论文数: 2.2K
被引数: 2.5K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
err分享
err收藏
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
err2016-01-01
err215
PREAI
errHuang, Xiaohua; Zhao, Guoying; Hong, Xiaopeng; Zheng, Wenming; Pietikainen, Matti
err分享
err收藏
Multi-task mid-level feature learning for micro-expression recognition
err2017-06-01
err43
PREAI
errHe, Jiachi; Hu, Jian-Fang; Lu, Xi; Zheng, Wei-Shi
err分享
err收藏
err分享
err收藏
An Outphase-Interleaved Switched-Capacitor Hybrid Buck Converter With Relieved Capacitor Inrush Current and COUT-Free Operations
err2024-04-01
err0
PREAI
errXiongjie Zhang; Qiaobo Ma; Yang Jiang; Anyang Zhao; Man-Kay Law; Rui P. Martins; Pui-In Mak
err分享
err收藏
A survey of micro-expression recognition
err2021-01-01
err26
PREAI
errZhou, Ling; Shao, Xiuyan; Mao, Qirong
err分享
err收藏
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
err2016-10-01
err329
PREAI
errLiu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan
err分享
err收藏
Electronic Structure and Photoluminescence Properties of Eu(η9-C9H9)2
err2019-11-26
err0
PREAI
errHarry Ramanantoanina; Lynda Merzoud; Jules Tshishimbi Muya; Henry Chermette; Claude Daul
err分享
err收藏
学者 查看更多内容