Return
FCL: frequency-based contrastive learning for generalizable face forgery detection
DOI:10.1007/s00530-026-02325-7.png)
Abstract
En 中文
With the proliferation of deepfake techniques, face forgery detection has emerged as a critical area of research to mitigate the risks associated with facial manipulation. Recent studies have highlighted the superiority of frequency information over color-space input, especially in high-compression scenarios. However, most frequency-enhanced methods employ a two-stream network architecture, assigning separate encoders for RGB and frequency domains, and rely solely on vanilla binary cross-entropy loss, limiting their generalization ability. To address these limitations, we propose a novel framework, Frequency-enhanced Contrastive Learning (FCL), which trains the model in a supervised manner using contrastive loss. FCL treats two views of different modalities generated from the same image as positive pairs and samples with opposite labels as negative pairs. This approach pulls features from the RGB and high-frequency domains closer while pushing features of pristine and forgery faces apart. Additionally, we introduce a Shallow Feature Supplement (SFS) module to complement local information from low-level shallow feature embeddings into high-level feature maps, and a Dual Modal Fusion (DMF) module to adaptively aggregate information from both domains. Extensive experiments on seven datasets demonstrate that our method achieves competitive generalization performance against state-of-the-art competitors, with significant advantages in heavily compressed scenarios. FCL achieves an accuracy of 92.29% and an AUC of 94.25% on the heavily compressed FaceForensics++ (LQ, C40) dataset, which verifies its robustness against compression in practical application scenarios. The source code of our proposed algorithm is available at https://github.com/Y30230924Wang/Frequency-Enhanced-Contrastive-Learning .
Keywords:
Face forgery detection
Frequency
Contrastive learning
Generalization ability
Journal
IF:
3.1
Papers:
2.7K
Citations:
2.7K

