返回
Improving generative adversarial network generalization for facialexpression synthesis
DOI:10.1007/s11042-026-21213-w.png)
摘要
En 中文
Facial expression synthesis aims to generate realistic facial expressions while preserving identity. Existing conditional generative adversarial networks (GANs) achieve excellent image-to-image translation results, but their performance often degrades when test images differ from the training dataset. We present Regression GAN (RegGAN), a model that learns an intermediate representation to improve generalization beyond the training distribution. RegGAN consists of two components: a regression layer with local receptive fields that learns expression details by minimizing the reconstruction error through a ridge regression loss, and a refinement network trained adversarially to enhance the realism of generated images. We train RegGAN on the CFEE dataset and evaluate its generalization performance both on CFEE and challenging out-of-distribution images, including celebrity photos, portraits, statues, and avatar renderings. For evaluation, we employ four widely used metrics: Expression Classification Score (ECS) for expression quality, Face Similarity Score (FSS) for identity preservation, QualiCLIP for perceptual realism, and Fréchet Inception Distance (FID) for assessing both expression quality and realism. RegGAN outperforms six state-of-the-art models in ECS, FID, and QualiCLIP, while ranking second in FSS. Human evaluations indicate that RegGAN surpasses the best competing model by 25% in expression quality, 26% in identity preservation, and 30% in realism.
Keyword:
Facial expression synthesis
Generative adversarial network
Out-of-distribution
Refinement network
Ridge Regression layer
期刊
IF:
3
论文数:
2.0W
被引数:
3.2W
机构
引用论文
The Devil is in the Details: StyleFeatureEditor for Detail-Rich StyleGAN Inversion and High Quality Image Editing细节决定成败:StyleFeatureEditor 用于细节丰富的 StyleGAN 反演和高质量图像编辑
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks使用循环一致的对抗网络进行不成对的图像到图像的翻译

