arrow
Return

SamBaS: Sampling-Based Stochastic Block Partitioning

delete2024-05-01
delete0
delete
OA
AI
F
Frank Wanye *
V
Vitaliy Gleyzer
E
Edward K. Kao
W
Wu-chun Feng
DOI:10.1109/TNSE.2024.3358301delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Community detection is a well-studied problem with applications in domains ranging from networking to bioinformatics. Due to the rapid growth in the volume of real-world data, there is growing interest in accelerating contemporary community detection algorithms. However, the more accurate and statistically robust methods tend to be hard to parallelize. One such method is stochastic block partitioning (SBP) - a community detection algorithm that works well on graphs with complex and heterogeneous community structure. In this paper, we present a sampling-based SBP (SamBaS) for accelerating SBP on sparse graphs. We characterize how various graph parameters affect the speedup and result quality of community detection with SamBaS and quantify the trade-offs therein. To evaluate SamBas on real-world web graphs without known ground-truth communities, we introduce partition quality score (PQS), an evaluation metric that outperforms modularity in terms of correlation with F1 score. Overall, SamBaS achieves speedups of up to 10x while maintaining result quality (and even improving result quality by over 150% on certain graphs, relative to F1 score).
Keywords:
Community detection
graph analytics
stochastic blockmodel
network sampling
performance modeling and evaluation

Journal

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
Papers:
2.5K
Citations:
10.0K

Organization

L
lincoln laboratory
Scholars:
962
Papers: 505
Citations: 0