返回
Efficient Approximate Range Aggregation Over Large-Scale Spatial Data Federation
DOI:10.1109/TKDE.2021.3084141.png)
摘要
En 中文
Range aggregation is a primitive operation in spatial data applications and there is a growing demand to support such operations over a data federation, where the entire spatial data are separately held by multiple data providers (a.k.a., data silos). Data federations notably increase the amount of data available for data-intensive applications such as smart mobility planning and public health emergency responses. Yet they also challenge the conventional implementation of range aggregation queries because the raw data cannot be shared within the federation and the data partition at each data silo is fixed during query processing. These constraints limit the design space of distributed range aggregation query processing and render existing solutions inefficient on large-scale data. In this work, we propose the first-of-its-kind approximate algorithms for efficient range aggregation over spatial data federation. We devise novel single-silo sampling algorithms that process queries in parallel and design a level sampling based algorithm which reduces the time complexity of local queries at each data silo to $O(\log \frac{1}{\epsilon })$O(log1 epsilon), where $\epsilon$epsilon is the approximation ratio of the accuracy guarantee. Extensive evaluations with real-world data show that compared with state-of-the-arts, our solutions reduce the time cost and communication cost by up to $85.1\times$85.1x and $5.5\times$5.5x respectively, with average approximate errors of below 2.8 percent. In addition, our solutions yield a throughput of over 250 queries per second, achieving real-time responses for real-world bike-sharing applications.
Keyword:
Spatial data federation
range aggregation
sampling
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Suppressor of Cytokine Signaling 1 (SOCS1) Mitigates Anterior Uveitis and Confers Protection Against Ocular HSV-1 Infection
Inflammation
IF0
Bleaching, coral mortality and subsequent survivorship on a West Australian fringing reef
Coral Reefs
IF0

