arrow
Return

GEMMA-SQL: A Novel Text-to-SQL Model Based on Large Language Models

delete2025-12-31
delete0
PRE
AI
H
Hari Mohan Pandey *
G
Gupta, Anshul
S
Subham Sarkar
M
Minakshi Tomer
J
Johannes J. Schneider
Y
Yan Gong
DOI:10.1080/08839514.2025.2587371delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Text-to-SQL systems enable users to interact with structured databases using natural language, eliminating the need for specialized programming knowledge. In this work, we introduce GEMMA-SQL, a lightweight and efficient text-to-SQL model built upon the open-source Gemma 2B architecture. Unlike many large language models (LLMs), GEMMA-SQL is fine-tuned in a resource-efficient, iterative manner and can be deployed on low-cost hardware. Leveraging the SPIDER benchmark for training and evaluation, GEMMA-SQL combines multiple prompting strategies, including few-shot learning, to enhance SQL query generation accuracy. The instruction-tuned variant, GEMMA-SQL Instruct, achieves 66.8% Test-Suite accuracy and 63.3% Exact Set Match accuracy, outperforming several state-of-the-art baselines such as IRNet, RYANSQL, and CodeXDavinci. The proposed approach demonstrates that effective prompt design and targeted instruction tuning can significantly boost performance while maintaining high scalability and adaptability. These results position GEMMA-SQL as a practical, open-source alternative for robust and accessible text-to-SQL systems.

Journal

A
Applied Artificial Intelligence
IF:
4.3
Papers:
84
Citations:
0

Organization

University of Liechtenstein cover
University of Liechtenstein
Scholars:
169
Papers: 216
Citations: 542
B
Bournemouth University
Scholars:
2.7K
Papers: 3.1K
Citations: 3.5K
M
maharaja surajmal institute of technology
Scholars:
179
Papers: 153
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Lost in the Middle: How Language Models Use Long Contexts
err2024-02-23
err56
errOAAI
errLiu, Nelson F.; Lin, Kevin; Hewitt, John; Paranjape, Ashwin; Bevilacqua, Michele; Petroni, Fabio; Liang, Percy
errShare
errSave
A survey on deep learning approaches for text-to-SQL
err2023-01-23
err0
errOAAI
errGeorge Katsogiannis-Meimarakis; Georgia Koutrika
errShare
errSave
Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
err2024-05-02
err0
errOAAI
errDawei Gao; Haibin Wang; Yaliang Li; Xiuyu Sun; Yichen Qian; Bolin Ding; Jingren Zhou
errShare
errSave
Efficient IR-Style Keyword Search over Relational Databases
err2003-01-01
err0
errOAAI
errVagelis Hristidis; Yannis Papakonstantinou; Luis Gravano
errShare
errSave
mRAT-SQL+GAP: A Portuguese Text-to-SQL Transformer
err2021-11-28
err0
PREAI
errMarcelo Archanjo José; Fabio Gagliardi Cozman
errShare
errSave
errShare
errSave
researcher View more