arrow
Return

Distributed Triangle Approximately Counting Algorithms in Simple Graph Stream

delete2022-01-08
delete9
PRE
AI
X
Xu Yang
C
Chao Song *
M
Mengdi Yu
J
Jiqing Gu
刘鸣 cover
刘鸣 (Ming Liu)
DOI:10.1145/3494562delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, the counting algorithm of local topology structures, such as triangles, has been widely used in social network analysis, recommendation systems, user portraits and other fields. At present, the problem of counting global and local triangles in a graph stream has beenwidely studied, and numerous triangle counting steaming algorithms have emerged. To improve the throughput and scalability of streaming algorithms, many researches of distributed streaming algorithms on multiple machines are studied. In this article, we first propose a framework of distributed streaming algorithm based on the Master-Worker-Aggregator architecture. The two core parts of this framework are an edge distribution strategy, which plays a key role to affect the performance, including the communication overhead and workload balance, and aggregation method, which is critical to obtain the unbiased estimations of the global and local triangle counts in a graph stream. Then, we extend the state-of-the-art centralized algorithm TRIEST into four distributed algorithms under our framework. Compared to their competitors, experimental results show that DVHT-i is excellent in accuracy and speed, performing better than the best existing distributed streaming algorithm. DEHT-b is the fastest algorithm and has the least communication overhead. What's more, it almost achieves absolute workload balance.
Keywords:
Global and local triangle counting
distributed streaming algorithm
graph stream

Journal

ACM Transactions on Knowledge Discovery from Data cover
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
Papers:
1.3K
Citations:
4.4K

Organization

X
xi'an jiaotong university
Scholars:
9.1W
Papers: 6.6W
Citations: 75