arrow
返回

Practical and high-quality partitioning algorithm for large-scale and time-evolving graphs

delete2021-09-01
delete1
PRE
AI
G
Gang Xin
桂小林 封面图
桂小林 (Xiaolin Gui)
J
Jia Wang
C
Cheng Guo *
DOI:10.1016/j.knosys.2021.107211delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the appearance of widespread large-scale graph data, distributed graph processing grows in popularity. In order to store and analyze a large-scale graph in a distributed manner, the graph should be properly partitioned in advance. Although the partitioning of static graphs has been sufficiently investigated, the emerging graphs nowadays are typically dynamic or time-evolving. State-of-the-art partitioning algorithms for such large-scale and time-evolving graphs either are impractical because of the complexity caused by the global optimization or sacrifice partitioning quality due to a huge number of cross partition edges. This paper investigates the problem and proposes a new practical and high-quality graph partitioning algorithm. First, graph updates accumulated in a time interval are expressed as a delta graph. Second, vertices in the delta graph are classified into several subsets based on a non-overlapping community detection method. Third, vertices in the same subset are assigned to a properly chosen partition as a whole. The chosen partition is lightly loaded as well as closely related with vertices in the subset. Experimental results show that compared with the widely used hash-based and heuristic-based partitioning algorithms, our proposed algorithm gains significant decrease in terms of the number of cross partition edges while maintaining a similar level of load balance. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Time-evolving graph
Graph partitioning
Distributed graph processing
Cross partition edge
Load balance
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
A
aviation industry corporation of china (avic)
学者数:
1.7K
论文数: 1.4K
被引数: 2
X
xi'an university of science & technology
学者数:
6.9K
论文数: 4.8K
被引数: 5
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Highly Efficient State-Selective Submicrosecond Photoionization Detection of Single Atoms
err2010-12-13
err0
errOAAI
errF. Henkel; M. Krug; J. Hofmann; W. Rosenfeld; M. Weber; H. Weinfurter
err分享
err收藏
On Multiplexity-Aware Influence Spread in Social Networks
err2020-01-01
err39
errOAAI
errYang, Lan; Yu, Zhenhua; El-Meligy, Mohammed A.; El-Sherbeeny, Ahmed M.; Wu, Naiqi
err分享
err收藏
err分享
err收藏
Contribution of Are1p and Are2p to steryl ester synthesis in the yeast Saccharomyces cerevisiae
err2001-12-25
err0
errOAAI
errDagmar Zweytick; Erich Leitner; Sepp D. Kohlwein; Chunjiang Yu; Jonathan Rothblatt; Günther Daum
err分享
err收藏
学者 查看更多内容