arrow
Return

XiYan-SQL: A Novel Multi-Generator Framework for Text-to-SQL

delete2026-01-26
delete0
PRE
AI
Y
Yifu Liu
Y
Yin Zhu
Y
Yingqi Gao
Z
Zhiling Luo
X
Xiaoxia Li
X
Xiaorong Shi
Y
Yuntao Hong
J
Jinyang Gao
Y
Yu Li
B
Bolin Ding
J
Jingren Zhou
DOI:10.1109/TKDE.2026.3657851delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To leverage the advantages of LLM in addressing challenges in the Text-to-SQL task, we present XiYan-SQL, an innovative framework effectively generating and utilizing multiple SQL candidates. It consists of three components: 1) a Schema Filter module filtering and obtaining multiple relevant schemas; 2) a multi-generator ensemble approach generating multiple high-quality and diverse SQL queries; 3) a selection model with a candidate reorganization strategy implemented to obtain the optimal SQL query. Specifically, for the multi-generator ensemble, we employ a multi-task fine-tuning strategy to enhance the capabilities of SQL generation models for the intrinsic alignment between SQL and text, and construct multiple generation models with distinct generation styles by fine-tuning across different SQL formats. The experimental results and comprehensive analysis demonstrate the effectiveness and robustness of our framework. Overall, XiYan-SQL achieves a new SOTA performance of 75.63% on the notable BIRD benchmark, surpassing all previous methods. It also attains SOTA performance on the Spider test set with an accuracy of 89.65%.
Keywords:
Generation
Text-to-SQL
multiple model ensemble
LLM fine-tuning strategy

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

A
Alibaba Cloud Computing Company Ltd.
Scholars:
12
Papers: 2
Citations: 0
Cited Papers

Cited Papers

Lost in the Middle: How Language Models Use Long Contexts
err2024-02-23
err56
errOAAI
errLiu, Nelson F.; Lin, Kevin; Hewitt, John; Paranjape, Ashwin; Bevilacqua, Michele; Petroni, Fabio; Liang, Percy
errShare
errSave
The Dawn of Natural Language to SQL: Are We Fully Ready?
err2024-08-30
err0
errOAAI
errBoyan Li; Yuyu Luo; Chengliang Chai; Guoliang Li; Nan Tang
errShare
errSave
errShare
errSave
Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
err2024-05-02
err0
errOAAI
errDawei Gao; Haibin Wang; Yaliang Li; Xiuyu Sun; Yichen Qian; Bolin Ding; Jingren Zhou
errShare
errSave
CodeS: Towards Building Open-source Language Models for Text-to-SQL
err2024-05-30
err0
errOAAI
errHaoyang Li; Jing Zhang; Hanbing Liu; Ju Fan; Xiaokang Zhang; Jun Zhu; Renjie Wei; Hongyan Pan; Cuiping Li; Hong Chen
errShare
errSave
researcher View more