arrow
返回

Multi-View Face Synthesis via Progressive Face Flow

delete2021-01-01
delete10
PRE
AI
Y
Yangyang Xu
徐
徐雪妙 (Xuemiao Xu)
J
Jianbo Jiao
K
Keke Li
C
Cheng Xu
S
Shengfeng He *
DOI:10.1109/TIP.2021.3090658delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Existing GAN-based multi-view face synthesis methods rely heavily on creating faces, and thus they struggle in reproducing the faithful facial texture and fail to preserve identity when undergoing a large angle rotation. In this paper, we combat this problem by dividing the challenging large-angle face synthesis into a series of easy small-angle rotations, and each of them is guided by a face flow to maintain faithful facial details. In particular, we propose a Face Flow-guided Generative Adversarial Network (FFlowGAN) that is specifically trained for small-angle synthesis. The proposed network consists of two modules, a face flow module that aims to compute a dense correspondence between the input and target faces. It provides strong guidance to the second module, face synthesis module, for emphasizing salient facial texture. We apply FFlowGAN multiple times to progressively synthesize different views, and therefore facial features can be propagated to the target view from the very beginning. All these multiple executions are cascaded and trained end-to-end with a unified back-propagation, and thus we ensure each intermediate step contributes to the final result. Extensive experiments demonstrate the proposed divide-and-conquer strategy is effective, and our method outperforms the state-of-the-art on four benchmark datasets qualitatively and quantitatively.
Keyword:
Faces
Face recognition
Generative adversarial networks
Image reconstruction
Facial features
Deep learning
Three-dimensional displays
Multi-view face synthesis
pose-invariant face recognition
face reconstruction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
Quality of life and audiologic performance through the ability to phone of cochlear implant users
err2014-12-20
err0
PREAI
errCécile Rumeau; Julien Frère; Bettina Montaut-Verient; Alexis Lion; Gérome Gauchard; Cécile Parietti-Winkler
err分享
err收藏
Chibchan languages
err2012-01-13
err0
PREAI
errAdolfo Constenla Umaña
err分享
err收藏
Pathological Features and Clinical Course in Patients With Recurrent or Malignant Orbital Solitary Fibrous Tumor/Hemangiopericytoma
err2019-03-01
err0
PREAI
errOded Sagiv; Diana Bell; Yunxia Guo; Shirley Su; Sara T. Wester; Kailun Jiang; Vivian T. Yin; Roman Shinder; Brent Hayek; Hee Joon Kim; Michael T. Tetzlaff; Bita Esmaeli
err分享
err收藏
err分享
err收藏
Breakdown of the Mott-Hubbard State inFe2O3: A First-Order Insulator-Metal Transition with Collapse of Magnetism at 50 GPa
err1999-06-07
err0
PREAI
errM. P. Pasternak; G. Kh. Rozenberg; G. Yu. Machavariani; O. Naaman; R. D. Taylor; R. Jeanloz
err分享
err收藏
Locally linear regression for pose-invariant face recognition
err2007-07-01
err242
PREAI
errChai, Xiujuan; Shan, Shiguang; Chen, Xilin; Gao, Wen
err分享
err收藏
学者 查看更多内容