arrow
返回

Scheduling distributed multiway spatial join queries: optimization models and algorithms

delete2023-02-06
delete0
delete
OA
AI
T
Thiago Borges de Oliveira *
F
Fábio M. Costa
L
L. R. Foulds
H
Humberto J. Longo
DOI:10.1080/13658816.2023.2170380delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multiway spatial joins are a commonly occurring and fundamental type of query for spatial data processing. This article presents models and algorithms to schedule this type of query in distributed database systems while attempting to strike a balance between makespan and communication costs. We propose three algorithms based on combinatorial optimization methods: the well-known linear relaxation technique of rounding a solution generated by linear programming (LP), a more sophisticated Lagrangian Relaxation method (LR), as well as a greedy heuristic (GR) for baseline comparison. Our evaluation shows that a schedule built using GR consumes, on average, 22% more processing and communication resources than a more elaborate schedule constructed via the LR method, when scheduling a query for 64 machines. The schedule provided by LR is also, on average, an order of magnitude closer to the optimal schedule for a query compared to GR. We show that scheduling Gigabyte-size multiway queries before execution can reduce its processing time by an order of magnitude compared to state-of-the-art frameworks for spatial data processing that do not have this capability, and can significantly reduce the amount of shuffled data in the network.
Keyword:
Multiway spatial join
Distributed query scheduling
Lagrangian relaxation

期刊

International Journal of Geographical Information Science 封面图
International Journal of Geographical Information Science
IF:
5.1
论文数:
2.7K
被引数:
9.3K

机构

U
universidade federal de goias
学者数:
7.2K
论文数: 4.5K
被引数: 4
引用论文

引用论文

MapReduce and Parallel DBMSs: Friends or Foes?MapReduce和并行dbms: 朋友还是敌人?
err2010-01-01
err226
PREAI
errStonebraker, Michael; Abadi, Daniel; Dewitt, David J.; Madden, Sam; Paulson, Erik; Pavlo, Andrew; Rasin, Alexander
err分享
err收藏
err分享
err收藏
Efficacy and Safety of Tirofiban in Clinical Patients With Acute Ischemic Stroke
err2022-02-08
err0
errOAAI
errBin Han; Teng Ma; Zhendong Liu; Yiqun Wu; Weiwei Tan; Shaoyang Sun; Xuemei Li; Changyan Shao; Duyong Tang; Jinping Sun
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Bulk chemical and Hf–W isotopic consequences of incomplete accretion during planet formation
err2015-01-01
err0
PREAI
errChristina A. Dwyer; Francis Nimmo; John E. Chambers
err分享
err收藏
Treatment of Progressive Scleromalacia Perforans by Tectonic Enhancement With Lyophilized Equine Pericardium
err2020-08-17
err0
PREAI
errKonstantinos Droutsas; Ioannis Giachos; Vasiliki Katsiampoula; Persefoni Kourti; Georgios Kymionis; Petros Petrou
err分享
err收藏
Performance Assessment of Emergency Teams and Communication in Trauma Care (PERFECT checklist)—Explorative analysis, development and validation of the PERFECT checklist: Part of the prospective longitudinal mixed-methods EPPTC trial
err2018-08-24
err0
errOAAI
errDavid Häske; Stefan K. Beckers; Marzellus Hofmann; Rolf Lefering; Christine Preiser; Bernhard Gliwitzky; Paul Alfred Grützner; Ulrich Stöckle; Matthias Münzberg
err分享
err收藏
err分享
err收藏
学者 查看更多内容