arrow
返回

Scalable Suffix Sorting on a Multicore Machine

delete2020-09-01
delete6
PRE
AI
J
Jing Yi Xie
B
Bin Lao
W
Wentao Xu
DOI:10.1109/TC.2020.2972546delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
A number of methods have been proposed for suffix sorting on internal memory of RAM and external memory of hard disks. The current best results for suffix sorting on internal or external memory are achieved by several algorithms using the induced sorting (IS) method in various ways. While these algorithms are efficient, the internal ones are much different from those external in terms of the algorithm designs. A scalable IS method that can be applied for suffix sorting on both internal and external memory is highly desired. This article proposes a blockwise IS method to facilitate pipelined access on internal memory and sequential I/Os on external memory. The detailed algorithm of using this method for a 4-stage pipeline with multiple threads is described, where multiple threads are applied to parallelize not only the pipelined stages of consecutive blocks but also the tasks within each stage wherever possible. This algorithm is evaluated by our experiments on a set of realistic and artificial datasets to achieve better overall time and space performance than the existing best results from pSACAK, pDSS and pKS. Beside sorting suffixes on internal memory in linear time, the proposed method can be ported to external memory for sorting massive suffixes in linear I/O complexity.
Keyword:
Sorting
Random access memory
Indexes
Multicore processing
Arrays
Task analysis
Big Data
Suffix sorting
algorithm design
multicore computer
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
G
Guangdong University of Foreign Studies
学者数:
1.3K
论文数: 1.4K
被引数: 1.5K
引用论文

引用论文

Modified parameterization of the Li-Petrasso charged-particle stopping power theory
err2019-12-05
err0
errOAAI
errA. B. Zylstra; H. G. Rinderknecht; J. A. Frenje; C. K. Li; R. D. Petrasso
err分享
err收藏
A bioinformatician's guide to the forefront of suffix array construction algorithms
err2014-01-10
err23
errOAAI
errShrestha, Anish Man Singh; Frith, Martin C.; Horton, Paul
err分享
err收藏
Checking Big Suffix and LCP Arrays by Probabilistic Methods
err2017-10-01
err5
PREAI
errWu, Yi; Nong, Ge; Chan, Wai Hong; Han, Ling Bo
err分享
err收藏
A taxonomy of suffix array construction algorithms
err2007-07-06
err168
PREAI
errPublisi, Simon J.; Smyth, W. F.; Turpin, Andrew H.
err分享
err收藏
40 Years of Suffix Trees
err2016-03-23
err22
errOAAI
errApostolico, Alberto; Crochemore, Maxime; Farach-Colton, Martin; Galil, Zvi; Muthukrishnan, S.
err分享
err收藏
学者 查看更多内容