.png){kind=icon}
返回
A learnable sampling method for scalable graph neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2023.03.015.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
With the development of graph neural networks, how to handle large-scale graph data has become an increasingly important topic. Currently, most graph neural network models which can be extended to large-scale graphs are based on random sampling methods. However, the sampling process in these models is detached from the forward propagation of neural networks. Moreover, quite a few works design sampling based on statistical estimation methods for graph convolutional networks and the weights of message passing in GCNs nodes are fixed, making these sampling methods not scalable to message passing networks with variable weights, such as graph attention networks. Noting the end-to-end learning capability of neural networks, we propose a learnable sampling method. It solves the problem that random sampling operations cannot calculate gradients and samples nodes with an unfixed probability. In this way, the sampling process is dynamically combined with the forward propagation process of the features, allowing for better training of the networks. And it can be generalized to all message passing models. In addition, we apply the learnable sampling method to GNNs and propose two models. Our method can be flexibly combined with different graph neural network models and achieves excellent accuracy on benchmark datasets with large graphs. Meanwhile, loss function converges to smaller values at a faster rate during training than past methods. (c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Graph neural networks
Large-scale data
Learnable sampling method
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Conjugated heat transfer and temperature distributions in a gas turbine combustion liner under base-load operation基本负荷运行下燃气轮机燃烧衬里中的共轭传热和温度分布
PREAI
分享收藏Dynamic patterning by the Drosophila pair-rule network reconciles long-germ and short-germ segmentation.png)
PLOS Biology
OAAI
PLOS BiologyIF0
OAAI分享收藏Profile based access control model in cloud computing environment2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE)
2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE)IF0
PREAI
分享收藏
查看更多内容