arrow
返回

Two provably consistent divide-and-conquer clustering algorithms for large networks

delete2021-10-29
delete6
delete
OA
AI
S
Soumendu Sundar Mukherjee *
P
Purnamrita Sarkar
P
Peter J. Bickel *
DOI:10.1073/pnas.2100482118delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we advance divide-and-conquer strategies for solv -ing the community detection problem in networks. We propose two algorithms that perform clustering on several small sub-graphs and finally patch the results into a single clustering. The main advantage of these algorithms is that they significantly bring down the computational cost of traditional algorithms, including spectral clustering, semidefinite programs, modularity-based methods, likelihood-based methods, etc., without losing accuracy, and even improving accuracy at times. These algorithms are also, by nature, parallelizable. Since most traditional algo-rithms are accurate, and the corresponding optimization prob-lems are much simpler in small problems, our divide-and-conquer methods provide an omnibus recipe for scaling traditional algo-rithms up to large networks. We prove the consistency of these algorithms under various subgraph selection procedures and per -form extensive simulations and real-data analysis to understand the advantages of the divide-and-conquer approach in various settings.
Keyword:
networks
divide-and-conquer
clustering

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

I
indian statistical institute kolkata
学者数:
761
论文数: 823
被引数: 1
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
I
Indian Statistical Institute
学者数:
1.7K
论文数: 1.8K
被引数: 1.2K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Structure and inference in annotated networks
err2016-06-16
err255
errOAAI
errNewman, M. E. J.; Clauset, Aaron
err分享
err收藏
ON SEMIDEFINITE RELAXATIONS FOR THE BLOCK MODEL
err2018-02-01
err104
errOAAI
errAmini, Arash A.; Levina, Elizaveta
err分享
err收藏
学者 查看更多内容