arrow
返回

Fast Communication-Efficient Spectral Clustering over Distributed Data

delete2021-03-01
delete2
delete
OA
AI
D
Donghui Yan *
H
Honggang Wang
J
Jin Wang
W
Wu, Guodong
W
Wang, Honggang
DOI:10.1109/TBDATA.2019.2907985delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The last decades have seen a surge of interests in distributed computing thanks to advances in clustered computing and big data technology. Existing distributed algorithms typically assume all the data are already in one place, and divide the data and conquer on multiple machines. However, it is increasingly often that the data are located at a number of distributed sites, and one wishes to compute over all the data with low communication overhead. For spectral clustering, we propose a novel framework that enables its computation over such distributed data, with minimal communications while a major speedup in computation. The loss in accuracy is negligible compared to the non-distributed setting. Our approach allows local parallel computing at where the data are located, thus turns the distributed nature of the data into a blessing; the speedup is most substantial when the data are evenly distributed across sites. Experiments on synthetic and large UC Irvine datasets show almost no loss in accuracy with our approach while a 2x speedup under various settings with two distributed sites. As the transmitted data need not be in their original form, our framework readily addresses the privacy concern for data sharing in distributed computing.
Keyword:
Distributed databases
Big Data
Clustering algorithms
Data mining
Distortion
Business
Spectral clustering
distributed data
data sharing
communication efficient
distortion minimizing local transformation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
887
被引数:
3.0K

机构

U
University Massachusetts Dartmouth
学者数:
1.0K
论文数: 932
被引数: 7
U
university of massachusetts system
学者数:
3.9W
论文数: 3.6W
被引数: 42
引用论文

引用论文

Towards energy-autonomous wake-up receiver using Visible Light Communication
err2016-01-01
err0
errOAAI
errJoyce Sariol Ramos; Ilker Demirkol; Josep Paradells; Daniel Vossing; Karim M. Gad; Martin Kasemann
err分享
err收藏
Reaction of cobalt tetracarbonyl hydride with phenylacetylene
err1999-07-01
err0
PREAI
errT.Michael Bockman; John F. Garst; Ferenc Ungváry
err分享
err收藏
Molecular analysis of the lymphocyte membrane
err1984-09-01
err0
PREAI
errGregory W. Warr; Gerardo R. Vasta; John J. Marchalonis; Robert C. Allen; Douglas P. Anderson
err分享
err收藏
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
err分享
err收藏
学者 查看更多内容