Text-to-SQL on BIRD and Spider Combined
74.4Execution Accuracy (EX)LearNAT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LearNATLLMs=Qwen2.5-Coder-32B, Level=Ours2025.04 | 74.4 | 1.8 | 41.3 | |
| LearNATLLMs=Qwen2.5-Coder-14B, Level=Ours2025.04 | 71.6 | 1.7 | 42.1 | |
| MAC-SQLLLMs=GPT-4, Level=System-Level2025.04 | 70.4 | 6.5 | 10.8 | |
| SuperSQLLLMs=GPT-4, Level=System-Level2025.04 | 70 | 9.1 | 7.7 | |
| LearNATLLMs=Qwen2.5-Coder-7B, Level=Ours2025.04 | 69.5 | 1.8 | 38.6 | |
| CodeSLLMs=CodeS-15B, Level=Model-Level2025.04 | 69.1 | 1.1 | 62.8 | |
| MAG-SQLLLMs=GPT-4, Level=System-Level2025.04 | 68.8 | 11.4 | 6 | |
| CodeSLLMs=CodeS-7B, Level=Model-Level2025.04 | 68.4 | 1.1 | 62.2 | |
| DAIL-SQLLLMs=GPT-4, Level=Model-Level2025.04 | 63.1 | 1.3 | 48.6 | |
| C3-SQLLLMs=GPT-4, Level=System-Level2025.04 | 63 | 21.2 | 3 | |
| ACT-SQLLLMs=GPT-4, Level=Model-Level2025.04 | 61.3 | 1.6 | 38.3 | |
| DIN-SQLLLMs=GPT-4, Level=System-Level2025.04 | 60.2 | 9.7 | 6.2 | |
| MetaSQLLLMs=GPT-4, Level=System-Level2025.04 | 56.5 | 10.1 | 5.6 |