arrow
返回

IA-FaceS: A bidirectional method for semantic face editing

delete2023-01-01
delete9
delete
OA
AI
W
Wenjing Huang
涂
涂仕奎 (Shikui Tu)
L
Lei Xu *
DOI:10.1016/j.neunet.2022.11.016delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Semantic face editing has achieved substantial progress in recent years. However, existing face editing methods, which often encode the entire image into a single code, still have difficulty in enabling flexible editing while keeping high-fidelity reconstruction. The one-code scheme also brings entangled face manipulations and limited flexibility in editing face components. In this paper, we present IA-FaceS, a bidirectional method for disentangled face attribute manipulation as well as flexible, controllable component editing. We propose to embed images onto two branches: one branch computes high-dimensional component-invariant content embedding for capturing face details, and the other provides low-dimensional component-specific embeddings for component manipulations. The two-branch scheme naturally enables high-quality facial component-level editing while keeping faithful reconstruction with details. Moreover, we devise a component adaptive modulation (CAM) module, which integrates component-specific guidance into the decoder and successfully disentangles highly-correlated face components. The single-eye editing is developed for the first time without editing face masks or sketches. According to the experimental results, IA-FaceS establishes a good balance between maintaining image details and performing flexible face manipulation. Both quanti-tative and qualitative results indicate that the proposed method outperforms the existing methods in reconstruction, face attribute manipulation, and component transfer. We release the code and weights at: https://github.com/CMACH508/IA-FaceS.(c) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Deep bidirectional method
Disentangled attribute manipulation
Facial component editing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Coupled 3D Reconstruction of Sparse Facial Hair and Skin
err2012-07-01
err66
PREAI
errBeeler, Thabo; Bickel, Bernd; Noris, Gioacchino; Beardsley, Paul; Marschner, Steve; Sumner, Robert W.; Gross, Markus
err分享
err收藏
Introduction to Veterinary Genetics
err
IF0
err2023-10-31
err0
PREAI
errF W Nicholas
err分享
err收藏
Real-time Expression Transfer for Facial Reenactment
err2015-11-02
err282
PREAI
errThies, Justus; Zollhoefer, Michael; Niessner, Matthias; Valgaerts, Levi; Stamminger, Marc; Theobalt, Christian
err分享
err收藏
Towards Disentangling Latent Space for Unsupervised Semantic Face Editing
err2022-01-01
err17
errOAAI
errLiu, Kanglin; Cao, Gaofeng; Zhou, Fei; Liu, Bozhi; Duan, Jiang; Qiu, Guoping
err分享
err收藏
err分享
err收藏
E2Style: Improve the Efficiency and Effectiveness of StyleGAN InversionE2Style: 提高StyleGAN反演的效率和有效性
err2022-01-01
err35
errOAAI
errWei, Tianyi; Chen, Dongdong; Zhou, Wenbo; Liao, Jing; Zhang, Weiming; Yuan, Lu; Hua, Gang; Yu, Nenghai
err分享
err收藏
Designing an Encoder for StyleGAN Image Manipulation设计用于StyleGAN图像处理的编码器
err2021-07-19
err385
errOAAI
errTov, Omer; Alaluf, Yuval; Nitzan, Yotam; Patashnik, Or; Cohen-Or, Daniel
err分享
err收藏
学者 查看更多内容