arrow
返回

Face De-Morphing Based on Diffusion Autoencoders

delete2024-01-01
delete2
PRE
AI
龙
龙敏 (Min Long)
Q
Quantao Yao
L
Le‐Bing Zhang *
F
Fei Peng
DOI:10.1109/TIFS.2024.3359029delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Face morphing attacks pose a significant threat to society as they disrupt the one-to-one mapping between facial images and identity features in face recognition systems. Despite the development of several detection methods to counter such attacks, the task of restoring the facial image of the accomplice from the morphed facial image, known as face de-morphing, remains a challenging problem. In this paper, we propose a novel diffusion-based method for face de-morphing. This method employs pre-trained diffusion autoencoders to encode the image into two subspaces: a semantic latent space that captures identity features and a stochastic latent space that retains the remaining stochastic details. To ensure the effective separation of identity features, a dual-branch identity separation network is constructed in the semantic latent space. This network utilizes a cross-attention inverse linear interpolation branch to separate the accomplice's semantic latent code and a multilayer perceptron branch to complement the separated latent code. Additionally, the morphed stochastic latent code is empirically chosen as the accomplice's stochastic latent code. Finally, a conditional denoising diffusion implicit model is used to decode the latent code of the two subspaces, thus achieving the restoration of the accomplice's facial image. Experimental results and analysis demonstrate that the proposed method outperforms existing face de-morphing methods in terms of restoration accuracy and image quality.
Keyword:
Feature extraction
Semantics
Faces
Image restoration
Face recognition
Codes
Stochastic processes
Face de-morphing
diffusion autoencoders
dual-branch identity separation network
semantic latent space
conditional denoising diffusion implicit model

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.3K
被引数:
2.3W

机构

G
Guangzhou University
学者数:
1.8W
论文数: 1.3W
被引数: 1.8W
H
Huaihua University
学者数:
912
论文数: 516
被引数: 612
引用论文

引用论文

Kinetics and Equilibria in Ligand Binding by Nitrophorins 1−4:  Evidence for Stabilization of a Nitric Oxide−Ferriheme Complex through a Ligand-Induced Conformational Trap
err2000-07-26
err0
PREAI
errJohn F. Andersen; Xiao D. Ding; Celia Balfour; Tatjana Kh. Shokhireva; Donald E. Champagne; F. Ann Walker; William R. Montfort
err分享
err收藏
SRDiff: Single image super-resolution with diffusion probabilistic modelsSRDiff: 具有扩散概率模型的单幅图像超分辨率
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
err分享
err收藏
Deep Face Representations for Differential Morphing Attack Detection
err2020-01-01
err61
errOAAI
errScherhag, Ulrich; Rathgeb, Christian; Merkle, Johannes; Busch, Christoph
err分享
err收藏
Tissue-culture-responsive and autotetraploidy-responsive changes in metabolic profiles of cucumber (Cucumis sativus L.)
err2006-03-01
err0
PREAI
errMarcin Filipecki; Zhimin Yin; Anita Wiśniewska; Mieczyław Śmiech; Robert Malinowski; Stefan Malepszy
err分享
err收藏
Characterization of monoclonal antibodies against bovine herpesvirus 1 gD fusion protein expressed in E. coli
err1999-12-01
err0
PREAI
errJaphet R.S Lyaku; Patricia K McKenna; Robert A Fredrickson; Frederick S.B Kibenge
err分享
err收藏
Face Demorphing
err2018-04-01
err84
PREAI
errFerrara, Matteo; Franco, Annalisa; Maltoni, Davide
err分享
err收藏
Border Control Morphing Attack Detection With a Convolutional Neural Network De-Morphing Approach
err2020-01-01
err23
errOAAI
errOrtega-Delcampo, David; Conde, Cristina; Palacios-Alonso, Daniel; Cabello, Enrique
err分享
err收藏
学者 查看更多内容