arrow
Return

Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection

delete2024-09-01
delete1
delete
OA
AI
C
Chuer Yu
X
Xuhong Zhang
Y
Yuxuan Duan
S
Senbo Yan
王总辉 (Zonghui Wang)
向阳 (Yang Xiang)
纪守领 (Shouling Ji)
W
Wenzhi Chen *
DOI:10.1109/TDSC.2024.3364679delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent years, DeepFake technologies have seen widespread adoption in various domains, including entertainment and film production. However, they have also been maliciously employed for disseminating false information and engaging in video fraud. Existing detection methods often experience significant performance degradation when confronted with unknown forgeries or exhibit limitations when dealing with low-quality images. To address this challenge, we introduce Diff-ID, a novel approach designed to elucidate and quantify the identity loss induced by facial manipulations. When assessing the authenticity of an image, Diff-ID leverages a genuine image of the same individual as a reference and processes two images jointly. It aligns the reference image and the test image into the same identity-insensitive attribute feature space using a face-swapping generator. This alignment allows us to observe the identity disparities between the two images through the differences in the aligned generation pairs. Subsequently, we have developed a custom metric designed to quantify the identity loss relative to the reference image in the test image. This metric effectively distinguishes forgery images from the real ones. Extensive experiments have demonstrated the exceptional performance of our approach. It achieves a high level of detection accuracy on DeepFake images and showcases state-of-the-art generalization capabilities when confronted with previously unknown forgery methods. Moreover, it exhibits robustness even in the presence of image distortions.
Keywords:
Faces
Forgery
Deepfakes
Feature extraction
Visualization
Shape
Robustness
Face forgery detection
generalization ability
identity difference

Journal

IEEE Transactions on Dependable and Secure Computing cover
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
Papers:
2.4K
Citations:
9.6K

Organization

S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
Z
zhejiang university
Scholars:
17.4W
Papers: 12.0W
Citations: 152