arrow
Return

R-FACE: Reference guided face component editing

delete2024-08-01
delete1
PRE
AI
Q
Qiyao Deng
J
Jie Cao
Y
Yunfan Liu
李
李琦 (Qi Li)
Zhenan Sun cover
Zhenan Sun (Zhenan Sun) *
DOI:10.1016/j.patcog.2024.110425delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although recent studies have made significant processes in face portrait editing, simple and accurate face component editing remains a challenge. Face components, such as eyes, nose, and mouth, have a shape style that is difficult to transfer. Existing methods either (1) manipulate pre-defined binary attribute labels, which is difficult to edit the shape of face components with observable changes, or (2) control the shape change by manually editing the intermediate representation (e.g., precise masks or sketches) of face components, which is time-consuming and requires painting skills. To break these limitations, we propose a simple and effective framework for diverse and controllable face component editing with geometric changes, which utilizes an inpainting model to learn the shape of face components from reference images without any manual annotations. In order to guide generated images to learn the shape style of reference face components, an example-guided attention module is designed to help the network focus on target face component regions. Moreover, a novel domain verification discriminator is introduced to pull the realism of the generated facial component close to the source face.
Keywords:
Face portrait editing
Face completion
Reference-guided

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

P
people's public security university of china
Scholars:
677
Papers: 423
Citations: 0
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Embedded Generation
err
IF0
err2000-01-01
err0
PREAI
errN. Jenkins; et al.
errShare
errSave
Simulation of the influence of a fine-scale urban underlying surface on the urban heat island effect in Beijing
err2021-11-01
err0
PREAI
errTian Liang; Jianjun He; Liang Chen; Zhangyu Yao; Lei Zhang; Huizheng Che; Sunling Gong
errShare
errSave
The Effect of 40-Hz Light Therapy on Amyloid Load in Patients with Prodromal and Clinical Alzheimer’s Disease
err2018-07-30
err0
errOAAI
errRola Ismail; Allan K. Hansen; Peter Parbo; Hans Brændgaard; Hanne Gottrup; David J. Brooks; Per Borghammer
errShare
errSave
errShare
errSave
errShare
errSave
Assessment of best single sample for finding chlamydia in women with and without symptoms: a diagnostic test study
errBMJ
IF0
err2012-12-12
err0
errOAAI
errS. A. Schoeman; C. M. W. Stewart; R. A. Booth; S. D. Smith; M. H. Wilcox; J. D. Wilson
errShare
errSave
An Early Triassic gladius associated with soft tissue remains from Idaho, USA—a squid-like coleoid cephalopod at the onset of Mesozoic Era
err2018-01-01
err0
errOAAI
errLarisa Doguzhaeva; Arnaud Brayard; Nicolas Goudemand; Laurel Krumenacker; James Jenk; Kevin Bylund; Emmanuel Fara; Nicolas x Olivier; Gilles Escarguel; Emmanuelle Vennin
errShare
errSave
researcher View more