arrow
Return

Suffix Array Construction in External Memory Using D-Critical Substrings

delete2014-01-01
delete15
PRE
AI
W
Wai Hong Chan
S
Sen Zhang
X
Xiao Feng Guan
DOI:10.1145/2518175delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a new suffix array construction algorithm that aims to build, in external memory, the suffix array for an input string of length n measured in the magnitude of tens of Giga characters over a constant or integer alphabet. The core of this algorithm is adapted from the framework of the original internal memory SA-DS algorithm that samples fixed-size d-critical substrings. This new external-memory algorithm, called EM-SA-DS, uses novel cache data structures to construct a suffix array in a sequential scanning manner with good data spatial locality: data is read from or written to disk sequentially. On the assumed external-memory model with RAM capacity Omega ((nB)(0.5)), disk capacity O(n), and size of each I/O block B, all measured in log n-bit words, the I/O complexity of EM-SA-DS is O(n/B). This work provides a general cache-based solution that could be further exploited to develop external-memory solutions for other suffix-array-related problems, for example, computing the longest-common-prefix array, using a modern personal computer with a typical memory configuration of 4GB RAM and a single disk.
Keywords:
Suffix array
sorting algorithm
external memory
Algorithms
Performance
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

E
education university of hong kong (eduhk)
Scholars:
2.0K
Papers: 3.2K
Citations: 1
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
researcher View more organizations
Cited Papers

Cited Papers

A taxonomy of suffix array construction algorithms
err2007-07-06
err168
PREAI
errPublisi, Simon J.; Smyth, W. F.; Turpin, Andrew H.
errShare
errSave
errShare
errSave
Measurement of the Coulomb energy loss by fast protons in a plasma target
err1996-03-01
err0
PREAI
errG. Belyaev; M. Basko; A. Cherkasov; A. Golubev; A. Fertman; I. Roudskoy; S. Savin; B. Sharkov; V. Turtikov; A. Arzumanov; A. Borisenko; I. Gorlachev; S. Lysukhin; D. H. H. Hoffmann; A. Tauschwitz
errShare
errSave
no more