arrow
返回

Efficient Graph Processing with Invalid Update Filtration

delete2021-07-01
delete2
PRE
AI
L
Long Zheng
X
Xianliang Li
X
Xiaofei Liao *
Z
Zhiyuan Shao
金
金海 (Hai Jin)
Q
Qiang-Sheng Hua
DOI:10.1109/TBDATA.2019.2921358delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most of existing graph processing systems essentially follow pull-based computation model to handle compute-intensive parts of graph iteration for high parallelism. Considering all vertices and edges are processed in each iteration, pull model may suffers from a large number of invalid (vertex/edge) operations that do not contribute to graph convergence, leading to potential performance degradation. In this paper, we have the insight that these invalid operations can be filtered by leveraging a small fraction of critical information. However, most of critical information are often beyond the visibility of active vertices being processed. We present two novel filtration approaches to (cooperatively) identify out-of-visibility critical information with boundary-cut heuristics and speculative prediction for many graph algorithms. We have integrated both approaches and their hybrid solution into three state-of-art graph processing systems (including Ligra, Gemini, and Polymer). Experimental results using a wide variety of graph algorithms on both real-world and synthetic graph datasets show that neither of these approaches can have an absolute win for all graph algorithms. Boundary-cut, predictive, and hybrid approaches can improve the performance by 115.1, 38.1, and 136.6 percent on average.
Keyword:
Convergence
Computational modeling
Big Data
Prediction algorithms
Schedules
Programming
Degradation
Graph processing
pull computation model
invalid update
performance
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
892
被引数:
3.0K

机构

暂无机构信息
引用论文

引用论文

Vinyl‐terminated oligomeric ethers: A study of the crosslinking process
err2003-03-10
err0
PREAI
errS. J. Barton; J. S. Ghotra; A. E. Matthews; G. Pritchard
err分享
err收藏
err分享
err收藏
Theory of mind and rule-based reasoning
err1995-10-01
err0
PREAI
errDouglas Frye; Philip David Zelazo; Tibor Palfai
err分享
err收藏
Combinatorial liposomal peptide vaccine induces IgA and confers protection against influenza virus and bacterial super‐infection
err2021-09-10
err0
errOAAI
errMehfuz Zaman; Victor C Huber; Dustin L Heiden; Katerina N DeHaan; Sanyogita Chandra; Demi Erickson; Victoria Ozberk; Manisha Pandey; Benjamin Bailly; Gael Martin; Emma L Langshaw; Ali Zaid; Mark von Itzstein; Michael F Good
err分享
err收藏
学者 查看更多内容