返回
Scheduling distributed multiway spatial join queries: optimization models and algorithms
DOI:10.1080/13658816.2023.2170380.png)
摘要
En 中文
Multiway spatial joins are a commonly occurring and fundamental type of query for spatial data processing. This article presents models and algorithms to schedule this type of query in distributed database systems while attempting to strike a balance between makespan and communication costs. We propose three algorithms based on combinatorial optimization methods: the well-known linear relaxation technique of rounding a solution generated by linear programming (LP), a more sophisticated Lagrangian Relaxation method (LR), as well as a greedy heuristic (GR) for baseline comparison. Our evaluation shows that a schedule built using GR consumes, on average, 22% more processing and communication resources than a more elaborate schedule constructed via the LR method, when scheduling a query for 64 machines. The schedule provided by LR is also, on average, an order of magnitude closer to the optimal schedule for a query compared to GR. We show that scheduling Gigabyte-size multiway queries before execution can reduce its processing time by an order of magnitude compared to state-of-the-art frameworks for spatial data processing that do not have this capability, and can significantly reduce the amount of shuffled data in the network.
Keyword:
Multiway spatial join
Distributed query scheduling
Lagrangian relaxation
期刊
IF:
5.1
论文数:
2.7K
被引数:
9.3K
机构
引用论文
Bulk chemical and Hf–W isotopic consequences of incomplete accretion during planet formation
Icarus
IF0
Treatment of Progressive Scleromalacia Perforans by Tectonic Enhancement With Lyophilized Equine Pericardium
Cornea
IF0
Performance Assessment of Emergency Teams and Communication in Trauma Care (PERFECT checklist)—Explorative analysis, development and validation of the PERFECT checklist: Part of the prospective longitudinal mixed-methods EPPTC trial
PLOS ONE
IF0

