arrow
返回

Designing an efficient parallel spectral clustering algorithm on multi-core processors in Julia

delete2020-04-01
delete16
PRE
AI
Z
Zenan Huo
G
Gang Mei *
G
Giampaolo Casolla
F
Fabio Giampaolo
DOI:10.1016/j.jpdc.2020.01.003delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Spectral clustering is widely used in data mining, machine learning and other fields. It can identify the arbitrary shape of a sample space and converge to the global optimal solution. Compared with the traditional k-means algorithm, the spectral clustering algorithm has stronger adaptability to data and better clustering results. However, the computation of the algorithm is quite expensive. In this paper, an efficient parallel spectral clustering algorithm on multi-core processors in the Julia language is proposed, and we refer to it as juPSC. The Julia language is a high-performance, open-source programming language. The juPSC is composed of three procedures: (1) calculating the affinity matrix, (2) calculating the eigenvectors, and (3) conducting k-means clustering. Procedures (1) and (3) are computed by the efficient parallel algorithm, and the COO format is used to compress the affinity matrix. Two groups of experiments are conducted to verify the accuracy and efficiency of the juPSC. Experimental results indicate that (1) the juPSC achieves speedups of approximately 14x similar to 18x on a 24-core CPU and that (2) the serial version of the juPSC is faster than the Python version of scikit-learn. Moreover, the structure and functions of the juPSC are designed considering modularity, which is convenient for combination and further optimization with other parallel computing platforms. (C) 2020 Elsevier Inc. All rights reserved.
Keyword:
Clustering algorithm
Spectral clustering
Parallel algorithm
Multi-core processors
Julia language
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Parallel and Distributed Computing 封面图
Journal of Parallel and Distributed Computing
IF:
4
论文数:
3.8K
被引数:
4.8K

机构

C
China University of Geosciences
学者数:
3.7W
论文数: 2.8W
被引数: 4.3W
U
University of Naples Federico II
学者数:
4.7W
论文数: 3.6W
被引数: 51
引用论文

引用论文

err分享
err收藏
Apolipoprotein E1 Lys-146 → Glu with type III hyperlipoproteinemia
err1992-09-01
err0
PREAI
errKengo Moriyama; Jun Sasaki; Akira Matsunaga; Fumiko Arakawa; Yoichi Takada; Keiichi Araki; Shuji Kaneko; Kikuo Arakawa
err分享
err收藏
Preemptive Action
err2019-05-02
err0
PREAI
errShunichi Kasahara; Jun Nishida; Pedro Lopes
err分享
err收藏
err分享
err收藏
Julia: A Fresh Approach to Numerical Computing朱莉娅: 一种新的数值计算方法
err2017-01-01
err3.6K
errOAAI
errBezanson, Jeff; Edelman, Alan; Karpinski, Stefan; Shah, Viral B.
err分享
err收藏
学者 查看更多内容