arrow
返回

Optimizing Parallel Clustering Throughput in Shared Memory

delete2017-09-01
delete9
delete
OA
AI
M
Michael Gowanlock *
D
D. M. Blair
V
Victor Pankratius
DOI:10.1109/TPDS.2017.2675421delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This article studies the optimization of parallel clustering throughput in the context of variant-based parallelism, which exploits commonalities and reuse among variant computations for multithreading scalability. This direction is motivated by challenging scientific applications where scientists have to execute multiple runs of clustering algorithms with different parameters to determine which ones best explain phenomena observed in empirical data. To make this process more efficient, we propose a novel set of optimizations to maximize the throughput of Density-Based Spatial Clustering of Applications with Noise (DBSCAN), a frequently used algorithm for scientific data mining in astronomy, geoscience, and many other fields. Our approach executes multiple algorithm variants in parallel, computes clusters concurrently, and leverages heuristics to maximize the reuse of results from completed variants. As scientific datasets continue to grow, maximizing clustering throughput with our techniques may accelerate the search and identification of natural phenomena of interest with computational support, i.e., Computer-Aided Discovery. We present evaluations on a whole spectrum of datasets, such as geoscience data on space weather phenomena, astronomical data from the Sloan Digital Sky Survey on intermediate-redshift galaxies, as well as synthetic datasets to characterize performance properties. Selected results show a 1,115 percent performance improvement due to indexing tailored for variant-based clustering, and a 2,209 percent performance improvement when applying all of our proposed optimizations.
Keyword:
Parallel clustering
clustering throughput
DBSCAN
data mining
computer-aided discovery
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
Computer-Aided Discovery: Toward Scientific Insight Generation with Machine Support
err2016-07-01
err17
PREAI
errPankratius, Victor; Li, Justin; Gowanlock, Michael; Blair, David M.; Rude, Cody; Herring, Tom; Lind, Frank; Erickson, Philip J.; Lonsdale, Colin
err分享
err收藏
MR-DBSCAN: a scalable MapReduce-based DBSCAN algorithm for heavily skewed data
err2013-12-19
err133
PREAI
errHe, Yaobin; Tan, Haoyu; Luo, Wuman; Feng, Shengzhong; Fan, Jianping
err分享
err收藏
Randomized Trial of 2 Versus 1 Dose of Measles Vaccine: Effect on Hospital Admission of Children After 9 Months of Age
err2017-06-15
err0
errOAAI
errMarie Brønd; Cesario L Martins; Stine Byberg; Christine S Benn; Hilton Whittle; May-Lill Garly; Peter Aaby; Ane B Fisker
err分享
err收藏
The PHEV Charging Infrastructure Planning (PCIP) Problem
err2010-06-27
err0
PREAI
errYogesh Dashora; John W Barnes; Rekha S Pillai; Todd E Combs; Michael Hilliard; Madhu S Chinthavali
err分享
err收藏
学者 查看更多内容