arrow
返回

Thorough Data Pruning for Join Query in Database System

delete2024-05-01
delete1
PRE
AI
G
Gao Jintao
Z
Zhanhuai Li
S
Sun Jian *
DOI:10.1109/TSUSC.2023.3279382delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The improvement of robustness and efficiency for multi-way equijoin query is challenging, no-matter for centralized database systems or distributed database systems. Due to lots of unnecessary data existing during query processing, these two metrics will be seriously reduced. If we can thoroughly prune unnecessary data in advance, the robustness and efficiency will be highly improved. However, the pruning power of current strategies, such as predicate push-down and algebraic equivalence, is limited. We present deepDP, a powerful, generalized, and efficient strategy for data pruning. deepDP builds multiple independent pruning spaces by generating longest transitive closures and applies appropriate data pruning strategy for each pruning space. For thoroughly pruning unnecessary data, deepDP employs alphabeta pruning strategy to clean each pruning space based on a newly designed statistic information-Hollow Range and re-shuffles the elements in all pruned spaces for maximizing robustness and efficiency benefits meanwhile minimizing the invasion. We implement deepDP in PostgreSQL but are not limited to it, and evaluate deepDP on TPC-H, JOB, and our synthesis benchmark-DHR. The experiment results show that compared to traditional data pruning strategy, deepDP can improve multi-way equijoin query on efficiency by 3.5x.
Keyword:
Robustness
Layout
Database systems
Benchmark testing
Query processing
Data models
Transforms
Data pruning
database system
hollow range
join query
query optimization

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.8K
被引数:
4.3K

机构

N
North Minzu University
学者数:
2.7K
论文数: 1.9K
被引数: 2.8K
N
Ningxia University
学者数:
7.9K
论文数: 5.1K
被引数: 6.6K
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
学者 查看更多机构
引用论文

引用论文

Identification and analysis of a glutamatergic local interneuron lineage in the adult Drosophila olfactory system
err2011-01-26
err0
errOAAI
errAbhijit Das; Albert Chiang; Sejal Davla; Rashi Priya; Heinrich Reichert; K VijayRaghavan; Veronica Rodrigues
err分享
err收藏
Infrared studies of the superconducting energy gap and normal-state dynamics of the high-TcsuperconductorYBa2Cu3O7
err1990-06-01
err0
PREAI
errZ. Schlesinger; R. T. Collins; F. Holtzberg; C. Feild; G. Koren; A. Gupta
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Pesticide Exposure and Re-Entry in Agriculture
err1995-01-01
err0
PREAI
errJoop J. van Hemmen; Yvette G. C. van Golstein Brouwers; Derk H. Brouwer
err分享
err收藏
学者 查看更多内容