arrow
返回

HFA-Net: hierarchical feature aggregation network for micro-expression recognition

delete2025-02-12
delete0
delete
OA
AI
M
Meng Zhang
W
Wenzhong Yang *
L
Liejun Wang
Z
Zhonghua Wu
D
Danny Chen
DOI:10.1007/s40747-025-01804-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Micro-expressions (MEs) are unconscious and involuntary reactions that genuinely reflect an individual's inner emotional state, making them valuable in the fields of emotion analysis and behavior recognition. MEs are characterized by subtle changes within specific facial action units, and effective feature learning and fusion tailored to these characteristics still require in-depth research. To address this challenge, this paper proposes a novel hierarchical feature aggregation network (HFA-Net). In the local branch, the multi-scale attention (MSA) block is proposed to capture subtle facial changes and local information. The global branch introduces the retentive meet transformers (RMT) block to establish dependencies between holistic facial features and structural information. Considering that single-scale features are insufficient to fully capture the subtleties of MEs, a multi-level feature aggregation (MLFA) module is proposed to extract and fuse features from different levels across the two branches, preserving more comprehensive feature information. To enhance the representation of key features, an adaptive attention feature fusion (AAFF) module is designed to focus on the most useful and relevant feature channels. Extensive experiments conducted on the SMIC, CASME II, and SAMM benchmark databases demonstrate that the proposed HFA-Net outperforms current state-of-the-art methods. Additionally, ablation studies confirm the superior discriminative capability of HFA-Net when learning feature representations from limited ME samples. Our code is publicly available at https://github.com/tairuwu/HFA-Net.
Keyword:
Micro-expression recognition
Attention mechanism
Multi-scale
Feature fusion

期刊

Complex and Intelligent Systems 封面图
Complex and Intelligent Systems
IF:
4.6
论文数:
2.1K
被引数:
6.6K

机构

X
Xinjiang University
学者数:
1.4W
论文数: 8.7K
被引数: 1.1W
引用论文

引用论文

Learning with noisy labels for robust fatigue detection基于噪声标签的鲁棒乏力检测学习
err2024-09-01
err2
PREAI
errWang, Mei; Hu, Ruimin; Zhu, Xiaojie; Zhu, Dongliang; Wang, Xiaochen
err分享
err收藏
Cross-to-merge training with class balance strategy for learning with noisy labels
err2024-09-01
err13
errOAAI
errZhang, Qian; Zhu, Yi; Yang, Ming; Jin, Ge; Zhu, Yingwen; Chen, Qiu
err分享
err收藏
Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods
err2018-10-01
err147
errOAAI
errLi, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikainen, Matti
err分享
err收藏
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
err分享
err收藏
Micro-attention for micro-expression recognition微注意在微表情识别中的应用
err2020-10-01
err93
errOAAI
errWang, Chongyang; Peng, Min; Bi, Tao; Chen, Tong
err分享
err收藏
An Outphase-Interleaved Switched-Capacitor Hybrid Buck Converter With Relieved Capacitor Inrush Current and COUT-Free Operations
err2024-04-01
err0
PREAI
errXiongjie Zhang; Qiaobo Ma; Yang Jiang; Anyang Zhao; Man-Kay Law; Rui P. Martins; Pui-In Mak
err分享
err收藏
学者 查看更多内容