.png){kind=icon}
返回
Efficient Parallel Skyline Query Processing for High-Dimensional Data
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2018.2809598.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Given a set of multidimensional data points, skyline queries retrieve those points that are not dominated by any other points in the set. Due to the ubiquitous se of skyline queries, such as in preference-based query answering and decision making, and the large amount of data that these queries have to deal with, enabling their scalable processing is of critical importance. However, there are several outstanding challenges that have not been well addressed. More specifically, in this paper, we are tackling the data straggler and data skew challenges introduced by distributed skyline query processing, as well as the ensuing high computation cost of merging skyline candidates. We thus introduce a new efficient three-phase approach for large scale processing of skyline queries. In the first preprocessing phase, the data is partitioned along the Z-order curve. We utilize a novel data partitioning approach that formulates data partitioning as an optimization problem to minimize the size of intermediate data. In the second phase, each compute node partitions the input data points into disjoint subsets, and then performs the skyline computation on each subset to produce skyline candidates in parallel. In the final phase, we build an index and employ an efficient algorithm to merge the generated skyline candidates. Extensive experiments demonstrate that the proposed skyline algorithm achieves more than one order of magnitude enhancement in performance compared to existing state-of-the-art approaches.
Keyword:
Skyline query
query processing
high-dimensional data
parallel computing
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
Wind energy delivery issues [transmission planning and competitive electricity market operation
.png){kind=icon}
PREAI
分享收藏Increased medial orbitofrontal [18F]fluorodopa uptake in Parkinsonian impulse control disorders
PREAI
分享收藏PDK2 induces cisplatin-resistance in lung adenocarcinoma via transcriptional regulation of CNNM3
PREAI
分享收藏
查看更多内容