arrow
返回

Patch-DFD: Patch-based end-to-end DeepFake discriminator

delete2022-08-01
delete18
PRE
AI
M
Miaomiao Yu
S
Sigang Ju
J
Jun Zhang
S
Shuohao Li *
J
Jun Lei
X
Xiaofei Li
DOI:10.1016/j.neucom.2022.06.013delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Facial forgery by DeepFake has recently attracted more public attention. Face image contains sensitive personal information, abuse of such technology will grow into a menace. Since the difference between real and fake faces is usually subtle and local, the general detection framework of applying the backbone network to capture the global features of the entire face and then feeding it into the binary classifier is not optimal. In addition, patch-based schemes are widely used in various computer vision tasks, including image classification. However, how to extract features for location-specific and arbitrary-shaped patches while preserving their original information and spoof patterns as much as possible requires further exploration. In this paper, a novel deep forgery detector called Patch-DFD is proposed, which applies a patch-based solution of Facial Patch Mapping (FPM) to obtain several part-based feature maps, preserving original details of each facial patch to the greatest extent. Besides, the BM-pooling module aims to fix the size of the feature maps while reducing quantization errors. The local voting strategy is finally used to fuse the results of parts detectors, so as to more accurately identify the fake faces generated by deep generative models. Compared to typical patch-wise framework that takes patch inputs, our scheme is more efficient due to the absence of repeated convolution operations. Moreover, extensive experiments conducted on publicly available face forensics datasets have proved that the effectiveness of our framework. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
DeepFake
Facial manipulation
Generative models
FPM
Local voting strategy

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

Multi-Scale Patch-Based Image Restoration
err2016-01-01
err224
PREAI
errPapyan, Vardan; Elad, Michael
err分享
err收藏
err分享
err收藏
Generative Adversarial Networks生成对抗网络
err2020-10-22
err1.0W
errOAAI
errGoodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua
err分享
err收藏
Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-Level Telltales
err2022-01-01
err44
errOAAI
errKong, Chenqi; Chen, Baoliang; Li, Haoliang; Wang, Shiqi; Rocha, Anderson; Kwong, Sam
err分享
err收藏
The Genetic Distance between the Coagulation Factor IX Gene and the Locus for the Fragile X Syndrome: Clinical Implications
err2009-07-11
err0
PREAI
errC. J. Forster-gibson; L. M. Mulligan; M. W. Partington; N. E. Simpson; J. J. A. Holden; B. N. White
err分享
err收藏
err分享
err收藏
学者 查看更多内容