Return
Face De-Morphing Based on Diffusion Autoencoders
DOI:10.1109/TIFS.2024.3359029.png)
Abstract
En 中文
Face morphing attacks pose a significant threat to society as they disrupt the one-to-one mapping between facial images and identity features in face recognition systems. Despite the development of several detection methods to counter such attacks, the task of restoring the facial image of the accomplice from the morphed facial image, known as face de-morphing, remains a challenging problem. In this paper, we propose a novel diffusion-based method for face de-morphing. This method employs pre-trained diffusion autoencoders to encode the image into two subspaces: a semantic latent space that captures identity features and a stochastic latent space that retains the remaining stochastic details. To ensure the effective separation of identity features, a dual-branch identity separation network is constructed in the semantic latent space. This network utilizes a cross-attention inverse linear interpolation branch to separate the accomplice's semantic latent code and a multilayer perceptron branch to complement the separated latent code. Additionally, the morphed stochastic latent code is empirically chosen as the accomplice's stochastic latent code. Finally, a conditional denoising diffusion implicit model is used to decode the latent code of the two subspaces, thus achieving the restoration of the accomplice's facial image. Experimental results and analysis demonstrate that the proposed method outperforms existing face de-morphing methods in terms of restoration accuracy and image quality.
Keywords:
Feature extraction
Semantics
Faces
Image restoration
Face recognition
Codes
Stochastic processes
Face de-morphing
diffusion autoencoders
dual-branch identity separation network
semantic latent space
conditional denoising diffusion implicit model
Journal
IF:
8
Papers:
5.3K
Citations:
2.3W
Organization
Cited Papers
Kinetics and Equilibria in Ligand Binding by Nitrophorins 1−4: Evidence for Stabilization of a Nitric Oxide−Ferriheme Complex through a Ligand-Induced Conformational Trap
Biochemistry
IF0
Studies on the sub-cellular location of particulate nitrate and nitrite reductase, glutamic dehydrogenase and other enzymes in barley roots
Planta
IF0
Border Control Morphing Attack Detection With a Convolutional Neural Network De-Morphing Approach
IEEE ACCESS
IF3.6

