arrow
Return

FCL: frequency-based contrastive learning for generalizable face forgery detection

delete2026-05-06
delete0
PRE
AI
祝瑜 cover
祝瑜 (Yu Zhu) *
S
Shengze Wang
Y
Yufeng Gu
Z
Ziming Zhu
N
Nan Wang *
DOI:10.1007/s00530-026-02325-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the proliferation of deepfake techniques, face forgery detection has emerged as a critical area of research to mitigate the risks associated with facial manipulation. Recent studies have highlighted the superiority of frequency information over color-space input, especially in high-compression scenarios. However, most frequency-enhanced methods employ a two-stream network architecture, assigning separate encoders for RGB and frequency domains, and rely solely on vanilla binary cross-entropy loss, limiting their generalization ability. To address these limitations, we propose a novel framework, Frequency-enhanced Contrastive Learning (FCL), which trains the model in a supervised manner using contrastive loss. FCL treats two views of different modalities generated from the same image as positive pairs and samples with opposite labels as negative pairs. This approach pulls features from the RGB and high-frequency domains closer while pushing features of pristine and forgery faces apart. Additionally, we introduce a Shallow Feature Supplement (SFS) module to complement local information from low-level shallow feature embeddings into high-level feature maps, and a Dual Modal Fusion (DMF) module to adaptively aggregate information from both domains. Extensive experiments on seven datasets demonstrate that our method achieves competitive generalization performance against state-of-the-art competitors, with significant advantages in heavily compressed scenarios. FCL achieves an accuracy of 92.29% and an AUC of 94.25% on the heavily compressed FaceForensics++ (LQ, C40) dataset, which verifies its robustness against compression in practical application scenarios. The source code of our proposed algorithm is available at https://github.com/Y30230924Wang/Frequency-Enhanced-Contrastive-Learning .
Keywords:
Face forgery detection
Frequency
Contrastive learning
Generalization ability

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.7K
Citations:
2.7K

Organization

E
electronics and communication engineering
Scholars:
194
Papers: 98
Citations: 0