arrow
Return

Efficient Top-k Retrieval on Massive Data

delete2015-10-01
delete13
PRE
AI
X
Xixian Han *
李
李建忠 (Jianzhong Li)
H
Hong Gao
DOI:10.1109/TKDE.2015.2426691delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In many applications, top-k query is an important operation to return a set of interesting points in a potentially huge data space. It is analyzed in this paper that the existing algorithms cannot process top-k query on massive data efficiently. This paper proposes a novel table-scan-based T2S algorithm to efficiently compute top-k results on massive data. T2S first constructs the presorted table, whose tuples are arranged in the order of the round-robin retrieval on the sorted lists. T2S maintains only fixed number of tuples to compute results. The early termination checking for T2S is presented in this paper, along with the analysis of scan depth. The selective retrieval is devised to skip the tuples in the presorted table which are not top-k results. The theoretical analysis proves that selective retrieval can reduce the number of the retrieved tuples significantly. The construction and incremental-update/batch-processing methods for the used structures are proposed in this paper. The extensive experimental results, conducted on synthetic and real-life data sets, show that T2S has a significant advantage over the existing algorithms.
Keywords:
Massive data
T2S algorithm
table scan
early termination
selective retrieval
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
Cited Papers

Cited Papers

IMMUNOMODULATION OF PANCREATIC ISLET ALLOGRAFTS IN MICE WITH CTLA4Ig SECRETING MUSCLE CELLS
err1995-05-01
err0
errOAAI
errA. ALFRED CHAHINE; MING YU; MELISSA M. MCKERNAN; CHRISTIAN STOECKERT; HENRY T. LAU
errShare
errSave
Classification, treatment and outcomes of a patient with lumbar extension syndrome
err2009-07-10
err0
PREAI
errMarcie Harris-Hayes; Linda R. Van Dillen; Shirley A. Sahrmann
errShare
errSave
A Survey of Top-k Query Processing Techniques in Relational Database Systems
err2008-10-15
err563
errOAAI
errIlyas, Ihab F.; Beskales, George; Soliman, Mohamed A.
errShare
errSave
Photoconducting properties of a ladder polymer
err1995-04-15
err0
PREAI
errK. S. Narayan; B. E. Taylor-Hamilton; R. J. Spry; J. B. Ferguson
errShare
errSave
Efficient Skyline Computation on Big Data
err2013-11-01
err57
PREAI
errHan, Xixian; Li, Jianzhong; Yang, Donghua; Wang, Jinbao
errShare
errSave
Effects of Y-27632 on the osteogenic and adipogenic potential of human dental pulp stem cells in vitro
err2022-04-07
err0
errOAAI
errZhiwei Xie; Qiuping Xu; Lu Sun; Ruijing Li; Jizhou Shi; Qian Yang; Min Zong; Jianyong Qin
errShare
errSave
Painful shoulder syndromes
err1992-05-01
err0
PREAI
errDavid L. Smith; Stephen M. Campbell
errShare
errSave
Development and validation of a predictive model algorithm to identify anaphylaxis in adults with type 2 diabetes in U.S. administrative claims data
err2021-05-05
err0
PREAI
errDaniel C. Beachler; Devon H. Taylor; Mary S. Anthony; Ruihua Yin; Ling Li; Catherine W. Saltus; Lin Li; Alka Shaunik; Kathleen E. Walsh; Kenneth J. Rothman; Catherine B. Johannes; Vanita R. Aroda; Warner Carr; Pinkus Goldberg; Andrew Accardi; John Shane O'Shura; Kristen Sharma; Juhaeri Juhaeri; Stephan Lanes; Chuntao Wu
errShare
errSave
researcher View more