arrow
Return

A unified framework for convolution-based graph neural networks

delete2024-11-01
delete0
PRE
AI
X
X. Y. Han
C
Chaofei Wang
Z
Zhuo Li
宋士吉 (Shiji Song)
G
Gao Huang *
吴澄 (Cheng Wu)
DOI:10.1016/j.patcog.2024.110597delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph Convolutional Networks (GCNs) have attracted a lot of research interest in machine learning, and many variants have been proposed recently. In this paper, we take a step forward to establish a unified framework for convolution -based graph neural networks, aiming to provide a systematic view of different GCN variants and deep understanding of the relations among them. Our key idea is formulating the basic graph convolution operation as an optimization problem in the graph Fourier space. Under this framework, a variety of popular GCN models, including vanilla-GCNs, attention -based GCNs and topology -based GCNs, can be interpreted as a similar optimization problem but with different regularizers. This novel perspective enables a better understanding of the similarities and differences among many widely used GCNs, and may inspire new model designs. As a showcase, we present a novel regularization technique under the proposed framework to tackle the oversmoothing problem in graph convolution. The effectiveness of newly designed model is validated empirically.
Keywords:
Laplacian optimization
Graph convolution network
Graph neural networks
Graph Fourier space
Oversmoothing

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137