arrow
Return

Graphusion: Latent Diffusion for Graph Generation

delete2024-11-01
delete2
PRE
AI
L
L. Yang
Z
Zhilong Zhang
Z
Zhongyi Liu
S
Shenda Hong
W
Wentao Zhang
杨文明 cover
杨文明 (Wenming Yang)
崔斌 cover
崔斌 (Bin Cui)
L
Luxia Zhang *
DOI:10.1109/TKDE.2024.3389783delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph generation is a fundamental task in machine learning with broad impacts on numerous real-world applications such as biomedical discovery and social science. Most recently, generative models, especially diffusion models (DMs), have shown great promise in synthesizing realistic graphs. However, existing DMs methods typically conduct diffusion processes directly in complex graph space (i.e., node feature, adjacency matrix, or both), resulting in high modeling complexity and poor multimodal distribution coverage. In this paper, we propose Graphusion, a novel and unified latent-based graph generative framework to address the problems. Specifically, Graphusion is composed of a variational graph autoencoder mapping raw graphs with high-dimensional discrete space to low-dimensional topology-injected latent space, and latent DMs running there, producing a smoother, faster, and more expressive graph generation procedure. Thanks to the latest space modeling, we further develop principled latent self-guidance to sufficiently cover the whole semantical distribution of the unlabeled graph set. Experiments show that our Graphusion framework can consistently outperform previous graph generation baselines on both generic and molecular graph datasets, demonstrating the generality and extensibility along with further analytical justifications.
Keywords:
Graph neural networks
deep generative models
diffusion models
graph generation
Graph neural networks
deep generative models
diffusion models
graph generation

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.7K
Citations:
3.2W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 10.0W
Citations: 137
P
peking university
Scholars:
11.7W
Papers: 8.7W
Citations: 146