.png){kind=icon}
返回
Improving Generalization by Commonality Learning in Face Forgery Detection
.png){kind=icon}
PRE
AI
DOI：10.1109/TIFS.2022.3146781.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper proposes a commonality learning strategy for face video forgery detection to improve the generalization. Considering various face forgery methods could leave certain similar forgery traces in videos, we attempt to learn the common forgery features from different forgery databases, so as to achieve better generalization in the detection of unknown forgery methods. Firstly, the Specific Forgery Feature Extractors (SFFExtractors) are trained separately for each of given forgery methods. We utilize the U-net structure and consider the triplet loss, location loss, classification loss, and automatic weighted loss to ensure the detection ability of SFFExtractors on the corresponding forgery methods. Next, the Common Forgery Feature Extractor (CFFExtractor) is trained under the supervision of SFFExtractors to explore the commonality of the forgery traces caused by different forgery methods. The extracted common forgery feature is expected to have a good generalization. The experimental results on FaceForensic++ show that the SFFExtractors outperform many state-of-the-arts in face forgery detection. The generalization performance of the CFFExtractor is verified on FaceForensic++, DFDC, and CelebDF. It is proved that commonality learning can be an effective strategy to improve generalization.
Keyword:
Forgery
Faces
Feature extraction
Videos
Information integrity
Task analysis
Frequency-domain analysis
Deep learning
deepfake
face swapping
video forensics
generalization ability
期刊
IF:
8
论文数:
5.2K
被引数:
2.3W
机构
引用论文
.png){kind=icon}
分享收藏
查看更多内容