arrow
Return

An improved face attributes editing method based on DDIM

delete2024-11-07
delete0
delete
OA
AI
L
Libo He
Q
Qingyang Chen
Y
Yun Pang
M
Meijiao Wang
Y
Yunyun Wu
L
Ling Liu
Z
Zhenping Qiang *
DOI:10.1038/s41598-024-78378-3delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The main advantage of DDIM is that it guarantees the quality of the generated images while increasing the efficiency of the generation by modifying the sampling strategy in the diffusion process. DiffusionRig, which addresses the problem of maintaining identity consistency by learning the person-specific facial prior in a tiny personalized dataset, is a successful representation of the DDIM strategy. Based on DiffusionRig, in this article, we propose an improved face attributes editing method based on DDIM to improve naturalness and accuracy of editing results in complex face attribute editing tasks and the generalization ability. Our method combines DDIM and DECA together and use two-stage training strategy. To reduce DiffusionRig's limitations in handling face attribute editing tasks that require nonlinear understanding and fine-tuning, our method also introduces a channel attention mechanism and a depth-separable convolution technique in the training model. In the first stage we trained our model on the open FFHQ dataset, which consists of 30,000 high-resolution face image. In the second stage, the model was refined by using a tiny personalized dataset. Face attribute editing experiments,comparative experiment with DiffusionRig, and a series of ablation experiments have been performed. Then, the validity of our improved method is verified by qualitative and quantitative analysis.
Keywords:
IMAGE
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.1W
Citations:
83.5W

Organization

S
southwest forestry university - china
Scholars:
3.5K
Papers: 2.0K
Citations: 2
Y
Yunnan Police College
Scholars:
79
Papers: 56
Citations: 5