arrow
返回

Efficient Graph Data Access for Out-of-Memory GPU Streaming Graph Processing

delete2025-07-01
delete0
PRE
AI
Q
Qiange Wang *
Y
Yongze Yan
H
Hongshi Tan
C
Cheng Chen
C
Cheng Zhao
J
Jiang, JX
X
Xiaoliang Cong
Y
Yanfeng Zhang
G
Ge Yu
W
Weng‐Fai Wong
Bingsheng He 封面图
Bingsheng He (Bingsheng He)
DOI:10.14778/3749646.3749659delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
利用GPU的高并行性可以显著提高流式图处理的实时计算效率。然而,当大规模图超出GPU内存容量时,CPU-GPU协同处理往往会导致大量的不规则CPU到GPU数据传输开销。这源于连续计算过程中广泛的冗余图访问,而现有方案难以解决这一问题。在本工作中,我们提出了Grapin,一个旨在通过两种有效技术减少冗余访问以最小化图数据传输的内存外GPU流式图处理系统:(1)通过将高级增量处理算法的重型数据依赖处理转换为GPU友好形式,将其扩展到GPU上,从计算端消除冗余图访问;(2)提供一种轻量级且高效的GPU热点子图管理框架,以顶点为中心的方式精细缓存频繁访问的动态子图。实验结果表明,Grapin能够高效地在单个NVIDIA A5000 GPU上处理包含数十亿条边的超大规模流式图。启用增量计算可减少61%的数据传输,而GPU热点子图复用的集成进一步减少了剩余传输的72%,总减少率达89%。与基于CPU的方案相比,Grapin实现了1.8倍至96.9倍(平均17.9倍)的加速比。
Keyword:
DYNAMIC GRAPH

期刊

P
Proceedings of the VLDB Endowment
IF:
3.3
论文数:
563
被引数:
1.2W

机构

N
national university of singapore
学者数:
4.6K
论文数: 2.4K
被引数: 1
N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Traversing large graphs on GPUs with unified memory
err2020-03-26
err0
errOAAI
errPrasun Gera; Hyojong Kim; Piyush Sao; Hyesoon Kim; David Bader
err分享
err收藏
Ascetic: Enhancing Cross-Iterations Data Efficiency in Out-of-Memory Graph Processing on GPUs
err2021-10-05
err0
PREAI
errRuiqi Tang; Ziyi Zhao; Kailun Wang; Xiaoli Gong; Jin Zhang; Wenwen Wang; Pen-Chung Yew
err分享
err收藏
Grus
err2021-02-09
err0
errOAAI
errPengyu Wang; Jing Wang; Chao Li; Jianzong Wang; Haojin Zhu; Minyi Guo
err分享
err收藏
Large graph convolutional network training with GPU-oriented data communication architecture
err2021-10-27
err0
errOAAI
errSeung Won Min; Kun Wu; Sitao Huang; Mert Hidayetoğlu; Jinjun Xiong; Eiman Ebrahimi; Deming Chen; Wen-mei Hwu
err分享
err收藏
EMOGI
err2020-11-16
err0
PREAI
errSeung Won Min; Vikram Sharma Mailthody; Zaid Qureshi; Jinjun Xiong; Eiman Ebrahimi; Wen-mei Hwu
err分享
err收藏
Automating incremental graph processing with flexible memoization
err2021-10-22
err0
PREAI
errShufeng Gong; Chao Tian; Qiang Yin; Wenyuan Yu; Yanfeng Zhang; Liang Geng; Song Yu; Ge Yu; Jingren Zhou
err分享
err收藏
GraphBolt
err2019-03-25
err0
PREAI
errMugilan Mariappan; Keval Vora
err分享
err收藏
Liberator: A Data Reuse Framework for Out-of-Memory Graph Computing on GPUs
err2023-06-01
err0
PREAI
errLi, Shiyang; Tang, Ruiqi; Zhu, Jingyu; Zhao, Ziyi; Gong, Xiaoli; Wang, Wenwen; Zhang, Jin; Yew, Pen-Chung
err分享
err收藏
学者 查看更多内容