Text-to-SQL on Spider Out-of-Domain (dev)
88.4Accuracy (Total)LearNAT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LearNATLLMs=Qwen2.5-Coder-32B2025.04 | 88.4 | 96.4 | 92.4 | 85.1 | 69.3 | |
| SuperSQLVenue=VLDB’24, LLMs=GPT-42025.04 | 87 | 94.4 | 91.3 | 83.3 | 68.7 | |
| LearNATLLMs=Qwen2.5-Coder-14B2025.04 | 86.9 | 95.6 | 91.5 | 80.5 | 68.7 | |
| MAC-SQLVenue=COLING’25, LLMs=GPT-42025.04 | 86.7 | — | — | — | — | |
| LearNATLLMs=Qwen2.5-Coder-7B2025.04 | 86.4 | 95.2 | 92.4 | 76.4 | 67.5 | |
| CodeSVenue=SIGMOD’24, LLMs=CodeS-7B2025.04 | 85.4 | 94.8 | 91 | 75.3 | 66.9 | |
| MAG-SQLLLMs=GPT-42025.04 | 85.3 | — | — | — | — | |
| CodeSVenue=SIGMOD’24, LLMs=CodeS-15B2025.04 | 84.9 | 95.6 | 90.4 | 78.2 | 61.4 | |
| CatSQLVenue=VLDB’23, LLMs=N/A2025.04 | 83.7 | 95.8 | 88.3 | 74.7 | 62.7 | |
| SENSEVenue=ACL’24, LLMs=CodeLLaMA-13B2025.04 | 83.5 | 95.2 | 88.6 | 75.9 | 60.3 | |
| C3-SQLLLMs=GPT-42025.04 | 82 | 92.7 | 85.2 | 77.6 | 62 | |
| DAIL-SQLVenue=VLDB’24, LLMs=GPT-42025.04 | 76.2 | 90.3 | 81.8 | 66.1 | 50.6 | |
| ACT-SQLVenue=EMNLP’23, LLMs=GPT-42025.04 | 74.5 | 91.1 | 79.4 | 67.8 | 44 | |
| DIN-SQLVenue=NeurIPS’23, LLMs=GPT-42025.04 | 74.2 | 91.1 | 79.8 | 64.9 | 43.4 | |
| MetaSQLVenue=ICDE’24, LLMs=GPT-42025.04 | 69.6 | 91.1 | 74.7 | 64.1 | 36.1 |