arrow
Return

Context-Patch Representation Learning With Adaptive Neighbor Embedding for Robust Face Image Super-Resolution

delete2023-01-01
delete3
PRE
AI
G
Guangwei Gao
Y
Yi Yu *
路慧敏 (Huimin Lu)
J
Jian Yang
D
Dong Yue
DOI:10.1109/TMM.2022.3192769delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Representation learning steered robust face image super-resolution (FSR) methods have attracted extensive attention in the past few decades. Most previous methods were devoted to exploiting the local position patches in the training set for FSR. However, they usually overlooked the sufficient usage of the contextual information around the testing patches, which are useful for stable representation learning. In this article, we attempt to utilize the context-patch around the testing patch and propose a method named context-patch representation learning with adaptive neighbor embedding (CRL-ANE) for FSR. On one hand, we simultaneously use the testing position patch and its adjacent ones for stable representation weight learning. This contextual information can compensate for recovering missing details in the target patch. On the other hand, for each input patch set, due to its inherent facial structural properties, we design an adaptive neighbor embedding strategy to elaborately and adaptively choose primary candidates for more accurate reconstruction. These two improvements enable the proposed method to achieve better SR performance than some of the other methods. Qualitative and quantitative experiments on some benchmarks have validated the superiority of the proposed method over some state-of-the-art methods.
Keywords:
Training
Faces
Image reconstruction
Face recognition
Representation learning
Adaptation models
Testing
Adaptive neighbor embedding
contextual information
face super-resolution
representation learning

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

K
Kyushu Institute of Technology
Scholars:
2.8K
Papers: 2.4K
Citations: 2.1K
N
national institute of informatics (nii) - japan
Scholars:
453
Papers: 420
Citations: 0
R
research organization of information & systems (rois)
Scholars:
2.8K
Papers: 3.2K
Citations: 2
researcher View more organizations