arrow
返回

Facial Expression Recognition on the High Aggregation Subgraphs

delete2023-01-01
delete3
PRE
AI
T
Tong Liu
J
Jing Li *
Jia Wu 封面图
Jia Wu (Jia Wu)
B
Bo Du
常军 封面图
常军 (Jun Chang)
Y
Yi Liu
DOI:10.1109/TIP.2023.3290520delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the development of deep learning technology, the performance of facial expression recognition (FER) has been significantly improved. The current main challenge comes from the confusion of facial expressions caused by the highly nonlinear changes of facial expressions. However, the existing FER methods based on Convolutional Neural Networks (CNN) often ignore the underlying relationship between expressions which is crucial to meliorate the performance of recognition for confusable expressions. And the methods based on Graph Convolutional Networks (GCN) can capture the relationship between vertices, but the aggregation degree of subgraphs generated by these methods is low. They are easy to include unconfident neighbors, which increases the learning difficulty of the network. To solve the above problems, this paper proposes a method to recognize facial expressions on the high aggregation subgraphs (HASs) by combing the advantages of CNN extracting features and GCN modeling complex graph patterns. Specifically, we formulate FER as a vertex prediction problem. Considering the importance of high-order neighbors and higher efficiency, we utilize vertex confidence to find high-order neighbors. Then we construct the HASs based on the top embedding features of these high-order neighbors. And we utilize the GCN to perform reasoning and infer the class of vertices for HASs without a large number of overlapping subgraphs. Our method captures the underlying relationship between expressions on the HASs and improves the accuracy and efficiency of FER. Experimental results on both the in-the-lab datasets and the in-the-wild datasets show that our method achieves higher recognition accuracy than several state-of-the-art methods. This highlights the benefit of the underlying relationship between expressions for FER.
Keyword:
Facial expression recognition
high aggregation subgraphs
high-order neighbors
relationship between expressions

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

M
Macquarie University
学者数:
1.2W
论文数: 1.5W
被引数: 2.2W
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Antibody-Recruiting Small Molecules: Synthetic Constructs as Immunotherapeutics
err2017-01-01
err0
PREAI
errPatrick J. McEnaney; Christopher G. Parker; Andrew X. Zhang
err分享
err收藏
err分享
err收藏
Quasiparticle Evidence for the Nematic State above Tc in SrxBi2Se3
err2019-07-10
err0
errOAAI
errYue Sun; Shunichiro Kittaka; Toshiro Sakakibara; Kazushige Machida; Jinghui Wang; Jinsheng Wen; Xiangzhuo Xing; Zhixiang Shi; Tsuyoshi Tamegai
err分享
err收藏
A Comprehensive Survey on Community Detection With Deep Learning基于深度学习的社区发现研究综述
err2024-04-01
err198
errOAAI
errSu, Xing; Xue, Shan; Liu, Fanzhen; Wu, Jia; Yang, Jian; Zhou, Chuan; Hu, Wenbin; Paris, Cecile; Nepal, Surya; Jin, Di; Sheng, Quan Z.; Yu, Philip S.
err分享
err收藏
学者 查看更多内容