Creating CREATE queries with multi-task deep neural networks

doi:10.1016/j.knosys.2023.110416

Creating CREATE queries with multi-task deep neural networks

2023-04-01

2

PRE

AI

C

C. Okan Sakar

DOI：10.1016/j.knosys.2023.110416

Original

Original request for help

Save

Abstract

En 中文

Text-to-SQL is the task of mapping natural language utterances to structured query language (SQL). Prior studies focus on information retrieval aspect of this task. In this paper, we demonstrate a new use case for the text-to-SQL studies where a user can create database models from natural language and introduce the first dataset for this task. Furthermore, we propose a framework that consists of three modular components: (1) classifier component which predicts the data type and constraints of a column, (2) constraint component which establishes foreign key relationships between tables, (3) query component which generates a series of CREATE queries through a slot-filling approach. We propose various baseline models to evaluate the classifier component in different aspects. Each model is based on a state-of-the-art pre-trained language model that allows us to assess contextualized word representations in the table creation task. The obtained results showed that such representations play a vital role in classifying column data types and constraints correctly. One of the downsides of pre-trained models is the training time and the model size. Our experiments revealed that a multi-task BERT model achieving 75% and 96% accuracy for the data type and constraint prediction tasks, respectively, effectively addresses both problems. (c) 2023 Elsevier B.V. All rights reserved.

Keywords:

Natural language processing

Deep neural networks

Transfer learning

Multi -task learning

Database schema creation

Creating CREATE queries with multi-task deep neural networks

Abstract

Journal

Organization