arrow
Return

Multi-query optimization for sketch-based estimation

delete2009-04-01
delete7
delete
OA
AI
A
Alin Dobra *
M
Minos Garofalakis
J
Johannes Gehrke
DOI:10.1016/j.is.2008.06.002delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Randomized techniques, based on computing small sketch synopses for each stream, have recently been shown to be a very effective tool for approximating the result of a single SQL query over streaming data tuples. In this paper, we investigate the problems arising when data-stream sketches are used to process multiple such queries concurrently. We demonstrate that, in the presence of multiple query expressions, intelligently sharing sketches among concurrent query evaluations can result in substantial improvements in the utilization of the available sketching space and the quality of the resulting approximation error guarantees. We provide necessary and sufficient conditions for multi-query sketch sharing that guarantee the correctness of the result-estimation process. We also investigate the difficult optimization problem of determining sketch-sharing configurations that are optimal (e.g., under a certain error metric for a given amount of space). We prove that optimal sketch sharing typically gives rise to N P-hard questions, and we propose novel heuristic algorithms for finding good sketch-sharing configurations in practice. Results from our experimental study with queries from the TPC-H benchmark verify the effectiveness of our approach, clearly demonstrating the benefits of our sketch-sharing methodology. (c) 2008 Elsevier B.V. All rights reserved.
Keywords:
Data streaming
Sketches
Approximate query processing
Multi-query optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Enterprise Information Systems cover
Enterprise Information Systems
IF:
3.9
Papers:
2.8K
Citations:
1.8K

Organization

U
University of Florida
Scholars:
4.0W
Papers: 3.1W
Citations: 6.6W
State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
Y
yahoo! inc
Scholars:
211
Papers: 208
Citations: 0
C
Cornell University
Scholars:
6.3W
Papers: 5.4W
Citations: 10.9W
researcher View more organizations