.png){kind=icon}
返回
Spatial-Temporal Graphs Plus Transformers for Geometry-Guided Facial Expression Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TAFFC.2022.3181736.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Facial expression recognition (FER) is of great interest to the current studies of human-computer interaction. In this paper, we propose a novel geometry-guided facial expression recognition framework, based on graph convolutional networks and transformers, to perform effective emotion recognition from videos. Specifically, we detect and utilize facial landmarks to construct a spatial-temporal graph, based on both the landmark coordinates and local appearance, for representing a facial expression sequence. The graph convolutional blocks and transformer modules are employed to produce high-semantic emotion-related representations from the structured facial graphs, which facilitate the framework to establish both the local and non-local dependency between the vertices. Moreover, spatial and temporal attention mechanisms are introduced into graph-based learning to promote FER reasoning, via the emphasis on the most informative facial components and frames. Extensive experiments demonstrate that the proposed framework achieves promising performance for geometry-based FER and shows great generalization and robustness in real-world applications.
Keyword:
Feature extraction
Facial expression recognition
spatial-temporal graph convolutional network
spatial-temporal transformer
attention mechanism
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
PREAI
分享收藏
Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements重新考虑情感表达: 从人类面部运动推断情感的挑战
OAAI
OAAI分享收藏Spatio-temporal convolutional features with nested LSTM for facial expression recognition基于时空卷积特征的嵌套LSTM人脸表情识别.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容