HSampler: Optimizing Multi-GPU GNN Sampling with Collision-Avoid Selection

doi:10.1007/978-3-032-10459-5_1

HSampler: Optimizing Multi-GPU GNN Sampling with Collision-Avoid Selection

2026-01-01

0

PRE

AI

DOI：10.1007/978-3-032-10459-5_1

Original

Original request for help

Save

Abstract

En 中文

Graph Neural Network (GNN) has emerged in graph learning tasks in recent years. As the real-world graphs become larger, sampled GNN is widely used in both academia and industry instead of training on the whole graph. As the training stage consumes less execution time due to the small size of sampled subgraphs, the data preparation stage becomes the performance bottleneck, especially the graph sampling stage. Many sampling methods have been proposed to improve the efficiency, but they still suffer from the significant overhead of the high-degree node selection collision in bias sampling. In this paper, we present HSampler, a multi-GPU GNN sampling system. It selects sampled subgraphs with reordering and sliding windows to reduce the repeated trials in biased sampling, thus improving the performance of the graph sampling stage. Evaluation on a node with 4 GPUs shows that HSampler significantly outperforms state-of-the-art systems like DGL and P-3 by 2.1x to 6.2x.

Keywords:

GNN

Biased Sampling

Performance Optimizations

Parallelism

HSampler: Optimizing Multi-GPU GNN Sampling with Collision-Avoid Selection

Abstract

Journal

Organization