Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection

Chuer Yu

doi:10.1109/TDSC.2024.3364679

Return

Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection

2024-09-01

DOI：10.1109/TDSC.2024.3364679

Original

Original request for help

Save

Abstract

En 中文

In recent years, DeepFake technologies have seen widespread adoption in various domains, including entertainment and film production. However, they have also been maliciously employed for disseminating false information and engaging in video fraud. Existing detection methods often experience significant performance degradation when confronted with unknown forgeries or exhibit limitations when dealing with low-quality images. To address this challenge, we introduce Diff-ID, a novel approach designed to elucidate and quantify the identity loss induced by facial manipulations. When assessing the authenticity of an image, Diff-ID leverages a genuine image of the same individual as a reference and processes two images jointly. It aligns the reference image and the test image into the same identity-insensitive attribute feature space using a face-swapping generator. This alignment allows us to observe the identity disparities between the two images through the differences in the aligned generation pairs. Subsequently, we have developed a custom metric designed to quantify the identity loss relative to the reference image in the test image. This metric effectively distinguishes forgery images from the real ones. Extensive experiments have demonstrated the exceptional performance of our approach. It achieves a high level of detection accuracy on DeepFake images and showcases state-of-the-art generalization capabilities when confronted with previously unknown forgery methods. Moreover, it exhibits robustness even in the presence of image distortions.

Keywords:

Faces

Forgery

Deepfakes

Feature extraction

Visualization

Shape

Robustness

Face forgery detection

generalization ability

identity difference