.png){kind=icon}
返回
Syncretic Space Learning Network for NIR-VIS Face Recognition
.png){kind=icon}
OA
AI
DOI：10.1145/3607143.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
To overcome the technical bottleneck of face recognition in low-light scenarios, Near-InfraRed and VISible (NIR-VIS) heterogeneous face recognition is proposed for matching well-lit VIS faces with poorly lit NIR faces. Current cross-modal synthesis methods visually convert the NIR modality to the VIS modality and then perform face matching in the VIS modality. However, using a heavyweight GAN network on unpaired NIR-VIS faces may lead to high synthesis difficulty, low inference efficiency, and other problems. To alleviate the above problems, we simultaneously synthesize NIR and VIS images into modality-independent syncretic images and propose a novel syncretic space learning (SSL) model to eliminate the modal gap. First, Syncretic Modality Generator (SMG) synthesizes NIR and VIS images into syncretic images using channel-level convolution with a shallow CNN. In particular, the discriminative structural information is well preserved and the face quality can be further improved with small modal variations in a self-supervised learning manner. Second, Modality-adversarial Syncretic space Learning (MSL) projects NIR and VIS images into the syncretic space by a syncretic-modality adversarial learning strategy with syncretic pattern guided objective, so the modal gap of NIR-VIS faces can be effectively reduced. Finally, the Syncretic Distribution Consistency (SDC) constructed by NIR-syncretic, syncretic-syncretic, and VIS-syncretic consistency can enhance the intra-class compactness and learn discriminative representations. Extensive experiments on three challenging datasets demonstrate the effectiveness of the SSL method.
Keyword:
NIR-VIS face recognition
syncretic space learning
adversarial learning
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Spectrum-aware discriminative deep feature learning for multi-spectral face recognition.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏分享收藏LDA-GAN: Lightweight domain-attention GAN for unpaired image-to-image translationLDA GAN: 轻量级域关注GAN，用于不成对的图像到图像转换NEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏Common Marker Genes Identified from Various Sample Types for Systemic Lupus ErythematosusPLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏
查看更多内容