Cardinality estimation via learned dynamic sample selection

doi:10.1016/j.is.2023.102252

Cardinality estimation via learned dynamic sample selection

2023-07-01

1

PRE

AI

DOI：10.1016/j.is.2023.102252

Original

Original request for help

Save

Abstract

En 中文

Sampling is an effective approach to cardinality estimation which in turn is a key to query optimization in a DBMS. Although there have been a lot of studies on applying machine learning to cardinality estimation recently, enhancing sampling-based cardinality estimation by machine learning has been overlooked for a long time. In this paper, we propose a new sampling-based cardinality estimation method called LDSS by developing a learning-based dynamic sample selection method. Unlike the existing sampling-based methods that perform online sampling for every query, our method selects for the query the most suitable sample from the set of samples of various sizes that have been materialized during preprocessing. The cardinality of the query is then estimated based on the selected sample. Since our method is based on sampling, it can handle both single-table queries and join queries. Due to dynamic sample selection, costly online sampling is completely avoided. By learning the complex relationships between samples and queries, our learned sample selector can recommend small yet good samples for input queries. The extensive evaluation performed on the benchmarks indicates that LDSS can be trained much faster and can achieve higher accuracy than the state-of-the-art query-dependent methods and comparable accuracy to the current data-driven methods. & COPY; 2023 Elsevier Ltd. All rights reserved.

Keywords:

Cardinality estimation

Dynamic sample selection

Neural network

Cardinality estimation via learned dynamic sample selection

Abstract

Journal

Organization