arrow
Return

Face De-Morphing Based on Diffusion Autoencoders

delete2024-01-01
delete2
PRE
AI
龙
龙敏 (Min Long)
Q
Quantao Yao
L
Le‐Bing Zhang *
F
Fei Peng
DOI:10.1109/TIFS.2024.3359029delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Face morphing attacks pose a significant threat to society as they disrupt the one-to-one mapping between facial images and identity features in face recognition systems. Despite the development of several detection methods to counter such attacks, the task of restoring the facial image of the accomplice from the morphed facial image, known as face de-morphing, remains a challenging problem. In this paper, we propose a novel diffusion-based method for face de-morphing. This method employs pre-trained diffusion autoencoders to encode the image into two subspaces: a semantic latent space that captures identity features and a stochastic latent space that retains the remaining stochastic details. To ensure the effective separation of identity features, a dual-branch identity separation network is constructed in the semantic latent space. This network utilizes a cross-attention inverse linear interpolation branch to separate the accomplice's semantic latent code and a multilayer perceptron branch to complement the separated latent code. Additionally, the morphed stochastic latent code is empirically chosen as the accomplice's stochastic latent code. Finally, a conditional denoising diffusion implicit model is used to decode the latent code of the two subspaces, thus achieving the restoration of the accomplice's facial image. Experimental results and analysis demonstrate that the proposed method outperforms existing face de-morphing methods in terms of restoration accuracy and image quality.
Keywords:
Feature extraction
Semantics
Faces
Image restoration
Face recognition
Codes
Stochastic processes
Face de-morphing
diffusion autoencoders
dual-branch identity separation network
semantic latent space
conditional denoising diffusion implicit model

Journal

IEEE Transactions on Information Forensics and Security cover
IEEE Transactions on Information Forensics and Security
IF:
8
Papers:
5.3K
Citations:
2.3W

Organization

G
Guangzhou University
Scholars:
1.8W
Papers: 1.3W
Citations: 1.8W
H
Huaihua University
Scholars:
912
Papers: 516
Citations: 612
Cited Papers

Cited Papers

Kinetics and Equilibria in Ligand Binding by Nitrophorins 1−4:  Evidence for Stabilization of a Nitric Oxide−Ferriheme Complex through a Ligand-Induced Conformational Trap
err2000-07-26
err0
PREAI
errJohn F. Andersen; Xiao D. Ding; Celia Balfour; Tatjana Kh. Shokhireva; Donald E. Champagne; F. Ann Walker; William R. Montfort
errShare
errSave
SRDiff: Single image super-resolution with diffusion probabilistic models
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
errShare
errSave
Deep Face Representations for Differential Morphing Attack Detection
err2020-01-01
err61
errOAAI
errScherhag, Ulrich; Rathgeb, Christian; Merkle, Johannes; Busch, Christoph
errShare
errSave
Multimodal imaging of the retina and choroid in healthy Macaca fascicularis at different ages
err2019-01-25
err0
errOAAI
errShuxin Fan; Xiaoyan Ding; Pinhong Rao; Yingfeng Zheng; Fuxiang Mao; Youjin Hu; Xialin Liu; Guoping Fan
errShare
errSave
Tissue-culture-responsive and autotetraploidy-responsive changes in metabolic profiles of cucumber (Cucumis sativus L.)
err2006-03-01
err0
PREAI
errMarcin Filipecki; Zhimin Yin; Anita Wiśniewska; Mieczyław Śmiech; Robert Malinowski; Stefan Malepszy
errShare
errSave
Characterization of monoclonal antibodies against bovine herpesvirus 1 gD fusion protein expressed in E. coli
err1999-12-01
err0
PREAI
errJaphet R.S Lyaku; Patricia K McKenna; Robert A Fredrickson; Frederick S.B Kibenge
errShare
errSave
Face Demorphing
err2018-04-01
err84
PREAI
errFerrara, Matteo; Franco, Annalisa; Maltoni, Davide
errShare
errSave
Border Control Morphing Attack Detection With a Convolutional Neural Network De-Morphing Approach
err2020-01-01
err23
errOAAI
errOrtega-Delcampo, David; Conde, Cristina; Palacios-Alonso, Daniel; Cabello, Enrique
errShare
errSave
researcher View more