.png){kind=icon}
返回
Learning complex predicates for cardinality estimation using recursive neural networks
.png){kind=icon}
PRE
AI
DOI：10.1016/j.is.2024.102402.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Cardinality estimation is one of the most vital components in the query optimizer, which has been extensively studied recently. On one hand, traditional cardinality estimators, such as histograms and sampling methods, struggle to capture the correlations between multiple tables. On the other hand, current learning-based methods still suffer from the feature extraction of complex predicates and join relations, which will lead to inaccurate cost estimation, eventually a sub-optimal execution plan. To address these challenges, we present a novel end-to-end architecture leveraging deep learning to provide high-quality cardinality estimation. We exploit an effective feature extraction technique, which can fully make use of the structure of tables, join conditions and predicates. Besides, we use sampling-based technique to construct sample bitmaps for the tables and join conditions respectively. We also utilize the characteristics of predicate tree combined with recursive neural network to extract deep-level features of complex predicates. Finally, we embed these feature vectors into the model, which consists of three components: a recursive neural network, a graph convolutional neural network (GCN) and a multi-set convolutional neural network, to obtain the estimated cardinality. Extensive results conducted on real-world workloads demonstrate that our approach can achieve significant improvement in accuracy and be extended to queries with complex semantics.
Keyword:
Cardinality estimation
Recursive neural networks
Complex predicates
Sampling
期刊
IF:
3.9
论文数:
2.8K
被引数:
1.8K
机构
引用论文
9. Assessment of Academic Performance: The Impact of No Child Left Behind Policies on Bilingual Education: A Ten Year Retrospective9. 学术表现评估：《不让一个孩子掉队》政策对双语教育的影响：十年回顾
.png){kind=icon}
PREAI
分享收藏Deep Reinforcement Learning-Based Approach to Tackle Topic-Aware Influence Maximization基于深度强化学习的主题感知影响力最大化方法
OAAI
OAAI分享收藏A Survey on Advancing the DBMS Query Optimizer: Cardinality Estimation, Cost Model, and Plan Enumeration关于推进DBMS查询优化器的调查: 基数估计，成本模型和计划枚举OAAI
OAAI分享收藏
查看更多内容