arrow
Return

Local Graph Edge Partitioning

delete2021-09-23
delete9
PRE
AI
S
Shengwei Ji
C
Chenyang Bu
L
Lei Li
X
Xindong Wu *
DOI:10.1145/3466685delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph edge partitioning, which is essential for the efficiency of distributed graph computation systems, divides a graph into several balanced partitions within a given size to minimize the number of vertices to be cut. Existing graph partitioning models can be classified into two categories: offline and streaming graph partitioning models. The former requires global graph information during the partitioning, which is expensive in terms of time and memory for large-scale graphs. The latter creates partitions based solely on the received graph information. However, the streaming model may result in a lower partitioning quality compared with the offline model. Therefore, this study introduces a Local Graph Edge Partitioning model, which considers only the local information (i.e., a portion of a graph instead of the entire graph) during the partitioning. Considering only the local graph information is meaningful because acquiring complete information for large-scale graphs is expensive. Based on the Local Graph Edge Partitioning model, two local graph edge partitioning algorithms Two-stage Local Partitioning and Adaptive Local Partitioning are given. Experimental results obtained on 14 real-world graphs demonstrate that the proposed algorithms outperform rival algorithms in most tested cases. Furthermore, the proposed algorithms are proven to significantly improve the efficiency of the real graph computation system GraphX.
Keywords:
Local information
graph edge partitioning
distributed graph computing

Journal

ACM Transactions on Intelligent Systems and Technology cover
ACM Transactions on Intelligent Systems and Technology
IF:
6.6
Papers:
1.5K
Citations:
6.2K

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
Cited Papers

Cited Papers

Highly Efficient State-Selective Submicrosecond Photoionization Detection of Single Atoms
err2010-12-13
err0
errOAAI
errF. Henkel; M. Krug; J. Hofmann; W. Rosenfeld; M. Weber; H. Weinfurter
errShare
errSave
Anabelian geometry and descent obstructions on moduli spaces
err2016-08-30
err0
errOAAI
errStefan Patrikis; José Voloch; Yuri Zarhin
errShare
errSave
Structural elucidation of synthetic calcium silicates
err2012-02-29
err0
PREAI
errThomas Borrmann; James H. Johnston; Andrew J. McFarlane; Kenneth J. D. MacKenzie; Akihiko Nukui
errShare
errSave
Local Community Detection With the Dynamic Membership Function
err2018-10-01
err55
PREAI
errLuo, Wenjian; Zhang, Daofu; Jiang, Hao; Ni, Li; Hu, Yamin
errShare
errSave
Community Detection by Fuzzy Relations
err2020-04-01
err30
PREAI
errLuo, Wenjian; Yan, Zhenglong; Bu, Chenyang; Zhang, Daofu
errShare
errSave
researcher View more