Generalized and robust model for GAN-generated image detection

doi:10.1016/j.patrec.2024.04.018

Generalized and robust model for GAN-generated image detection

2024-06-01

2

PRE

AI

DOI：10.1016/j.patrec.2024.04.018

Original

Original request for help

Save

Abstract

En 中文

Generative adversarial network (GAN)-generated image detection is a crucial yet challenging problem. The advancement of diverse generative models makes it simpler to build realistic synthetic images, but it also increases the likelihood of using images maliciously. Recent techniques of fake image detection often overfit to specific GANs, incapable of generalizing to other GANs. Each GAN leaves its distinct fingerprint on the images it generates. We propose a simple and compact attention network that exploits high -frequency and noise residual patterns of images. We design two -channel image representations in the preprocessing phase, with one channel using a bilateral high pass filter (BiHPF) for high -frequency patterns and the other using photo response non -uniformity (PRNU) for noise residuals capturing from GAN-generated and real images. The feature maps pass through the attention network with a dense layer for classification tasks. We assess the generalizability and robustness of the model through extensive experiments. The model is evaluated on a benchmark dataset in various settings, including cross -category, cross-GAN models with varying class settings and different color manipulations. This study demonstrates that the proposed model outperforms state-of-the-art (SOTA) methods by approximately 5% in different experiment settings.

Keywords:

Deepfake

Generative adversarial network (GAN)

Photo response non-uniformity (PRNU)

Bilateral high pass filter (BiHPF)

Multi-head attention (MHA)

Generalized and robust model for GAN-generated image detection

Abstract

Journal

Organization