.png){kind=icon}
.png){kind=icon}
Return
Learning-Based Sample Tuning for Approximate Query Processing in Interactive Data Exploration
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2023.3341451.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
For interactive data exploration, approximate query processing (AQP) is a useful approach that usually uses samples to provide a timely response for queries by trading query accuracy. Existing AQP systems often materialize samples in the memory for reuse to speed up query processing. How to tune the samples according to the workload is one of the key problems in AQP. However, since the data exploration workload is so complex that it cannot be accurately predicted, existing sample tuning approaches cannot adapt to the changing workload very well. To address this problem, this paper proposes a deep reinforcement learning-based sample tuner, RL-STuner. When tuning samples, RL-STuner considers the workload changes from a global perspective and uses a Deep Q-learning Network (DQN) model to select an optimal sample set that has the maximum utility for the current workload. In addition, this paper proposes a set of optimization mechanisms to reduce the sample tuning cost. Experimental results on both real-world and synthetic datasets show that RL-STuner outperforms the existing sample tuning approaches and achieves 1.6x-5.2x improvements on query accuracy with a low tuning cost.
Keywords:
Measurement
Adaptation models
Costs
Tuners
Accuracy
Q-learning
Query processing
Optimization
Synthetic data
Approximate query processing
interactive data exploration
data analysis
Journal
IF:
10.4
Papers:
6.7K
Citations:
3.2W