.png){kind=icon}
返回
Graph Batch Coarsening framework for scalable graph neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2024.106931.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Due to the neighborhood explosion phenomenon, scaling up graph neural networks to large graphs remains a huge challenge. Various sampling-based mini-batch approaches, such as node-wise, layer-wise, and subgraph sampling, have been proposed to alleviate this issue. However, intensive random sampling incurs additional overhead during training and often fails to deliver good performance consistently. To surmount these limitations, we propose Graph Batch Coarsening (GBC), a simple and general graph batching framework designed to facilitate scalable training of arbitrary GNN models. GBC preprocesses the input graph and generates a set of much smaller subgraphs to be used as mini-batches; then any GNN model can be trained only on those small graphs. This framework avoids random sampling completely and makes no extra change on the backbone GNN models including hyperparameters. To implement the framework, we present a graph decomposition method based on label propagation and a novel graph coarsening algorithm designed for training GNN. Empirically, GBC demonstrates superior performance inaccuracy, training time and memory usage on various small to large-scale graphs.
Keyword:
Graph neural networks
Graph coarsening
Scalable training
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Temporal changes in prey composition and biomass delivery to African Crowned Eagle nestlings in urban areas of KwaZulu-Natal, South Africa.png)
Ostrich
OstrichIF0
PREAI
分享收藏Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning基于对抗性对比学习的自监督图级表示学习
OAAI
OAAI分享收藏
查看更多内容