.png){kind=icon}
Return
A learnable sampling method for scalable graph neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2023.03.015.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
With the development of graph neural networks, how to handle large-scale graph data has become an increasingly important topic. Currently, most graph neural network models which can be extended to large-scale graphs are based on random sampling methods. However, the sampling process in these models is detached from the forward propagation of neural networks. Moreover, quite a few works design sampling based on statistical estimation methods for graph convolutional networks and the weights of message passing in GCNs nodes are fixed, making these sampling methods not scalable to message passing networks with variable weights, such as graph attention networks. Noting the end-to-end learning capability of neural networks, we propose a learnable sampling method. It solves the problem that random sampling operations cannot calculate gradients and samples nodes with an unfixed probability. In this way, the sampling process is dynamically combined with the forward propagation process of the features, allowing for better training of the networks. And it can be generalized to all message passing models. In addition, we apply the learnable sampling method to GNNs and propose two models. Our method can be flexibly combined with different graph neural network models and achieves excellent accuracy on benchmark datasets with large graphs. Meanwhile, loss function converges to smaller values at a faster rate during training than past methods. (c) 2023 Elsevier Ltd. All rights reserved.
Keywords:
Graph neural networks
Large-scale data
Learnable sampling method
Journal
IF:
6.3
Papers:
8.2K
Citations:
3.0W
Organization
Cited Papers
ShareSaveDynamic patterning by the Drosophila pair-rule network reconciles long-germ and short-germ segmentation.png)
PLOS Biology
OAAI
PLOS BiologyIF0
OAAIShareSaveShareSaveProfile based access control model in cloud computing environment2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE)
2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE)IF0
PREAI
ShareSave
View more