.png){kind=icon}
Return
Improving Generalization by Commonality Learning in Face Forgery Detection
.png){kind=icon}
PRE
AI
DOI：10.1109/TIFS.2022.3146781.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This paper proposes a commonality learning strategy for face video forgery detection to improve the generalization. Considering various face forgery methods could leave certain similar forgery traces in videos, we attempt to learn the common forgery features from different forgery databases, so as to achieve better generalization in the detection of unknown forgery methods. Firstly, the Specific Forgery Feature Extractors (SFFExtractors) are trained separately for each of given forgery methods. We utilize the U-net structure and consider the triplet loss, location loss, classification loss, and automatic weighted loss to ensure the detection ability of SFFExtractors on the corresponding forgery methods. Next, the Common Forgery Feature Extractor (CFFExtractor) is trained under the supervision of SFFExtractors to explore the commonality of the forgery traces caused by different forgery methods. The extracted common forgery feature is expected to have a good generalization. The experimental results on FaceForensic++ show that the SFFExtractors outperform many state-of-the-arts in face forgery detection. The generalization performance of the CFFExtractor is verified on FaceForensic++, DFDC, and CelebDF. It is proved that commonality learning can be an effective strategy to improve generalization.
Keywords:
Forgery
Faces
Feature extraction
Videos
Information integrity
Task analysis
Frequency-domain analysis
Deep learning
deepfake
face swapping
video forensics
generalization ability
Journal
IF:
8
Papers:
5.3K
Citations:
2.3W
Organization
Cited Papers
.png){kind=icon}
ShareSaveShareSave
View more