arrow
Return

SAP: Improving Continuous Top-K Queries Over Streaming Data

delete2017-06-01
delete26
delete
OA
AI
R
Rui Zhu
B
Bin Wang *
X
Xiaochun Yang
B
Baihua Zheng
王国仁 (Guoren Wang)
DOI:10.1109/TKDE.2017.2662236delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Continuous top-k query over streaming data is a fundamental problem in database. In this paper, we focus on the sliding window scenario, where a continuous top-k query returns the top-k objects within each query window on the data stream. Existing algorithms support this type of queries via incrementally maintaining a subset of objects in the window and try to retrieve the answer from this subset as much as possible whenever the window slides. However, since all the existing algorithms are sensitive to query parameters and data distribution, they all suffer from expensive incremental maintenance cost. In this paper, we propose a self-adaptive partition framework to support continuous top-k query. It partitions the window into sub-windows and only maintains a small number of candidates with highest scores in each sub-window. Based on this framework, we have developed several partition algorithms to cater for different object distributions and query parameters. To our best knowledge, it is the first algorithm that achieves logarithmic complexity w.r.t. k for incrementally maintaining the candidate set even in the worst case scenarios.
Keywords:
Continuous top-k query
sliding window
streaming data
dynamic partition
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

S
Singapore Management University
Scholars:
1.5K
Papers: 2.5K
Citations: 3.5K
N
northeastern university - china
Scholars:
3.1W
Papers: 2.7W
Citations: 37