arrow
Return

PROUD: PaRetO-gUided diffusion model for multi-objective generation

delete2024-07-02
delete0
PRE
AI
Y
Yinghua Yao
Y
Yuangang Pan *
J
Jing Li
I
Ivor W. Tsang
X
Xin Yao
DOI:10.1007/s10994-024-06575-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advancements in the realm of deep generative models focus on generating samples that satisfy multiple desired properties. However, prevalent approaches optimize these property functions independently, thus omitting the trade-offs among them. In addition, the property optimization is often improperly integrated into the generative models, resulting in an unnecessary compromise on generation quality (i.e., the quality of generated samples). To address these issues, we formulate a constrained optimization problem. It seeks to optimize generation quality while ensuring that generated samples reside at the Pareto front of multiple property objectives. Such a formulation enables the generation of samples that cannot be further improved simultaneously on the conflicting property functions and preserves good quality of generated samples.Building upon this formulation, we introduce the ParetO-gUided Diffusion model (PROUD), wherein the gradients in the denoising process are dynamically adjusted to enhance generation quality while the generated samples adhere to Pareto optimality. Experimental evaluations on image generation and protein generation tasks demonstrate that our PROUD consistently maintains superior generation quality while approaching Pareto optimality across multiple property functions compared to various baselines
Keywords:
Multi-objective generation
Diffusion model
Pareto optimality
Generative model

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

A
a*star - institute of high performance computing (ihpc)
Scholars:
1.5K
Papers: 1.3K
Citations: 3
A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57