arrow
Return

R-FACE: Reference guided face component editing

delete2024-08-01
delete1
PRE
AI
Q
Qiyao Deng
J
Jie Cao
Y
Yunfan Liu
李琦 (Qi Li)
Z
Zhenan Sun *
DOI:10.1016/j.patcog.2024.110425delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although recent studies have made significant processes in face portrait editing, simple and accurate face component editing remains a challenge. Face components, such as eyes, nose, and mouth, have a shape style that is difficult to transfer. Existing methods either (1) manipulate pre-defined binary attribute labels, which is difficult to edit the shape of face components with observable changes, or (2) control the shape change by manually editing the intermediate representation (e.g., precise masks or sketches) of face components, which is time-consuming and requires painting skills. To break these limitations, we propose a simple and effective framework for diverse and controllable face component editing with geometric changes, which utilizes an inpainting model to learn the shape of face components from reference images without any manual annotations. In order to guide generated images to learn the shape style of reference face components, an example-guided attention module is designed to help the network focus on target face component regions. Moreover, a novel domain verification discriminator is introduced to pull the realism of the generated facial component close to the source face.
Keywords:
Face portrait editing
Face completion
Reference-guided

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

P
people's public security university of china
Scholars:
657
Papers: 414
Citations: 0
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704