Text-to-SQL on BIRD In-Domain (dev)
70.7Accuracy (Simple)LearNAT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LearNATLLMs=Qwen2.5-Coder-32B2025.04 | 70.7 | 55.5 | 59 | 65 | |
| LearNATLLMs=Qwen2.5-Coder-14B2025.04 | 68.5 | 51.4 | 45.8 | 61.2 | |
| SuperSQLVenue=VLDB’24, LLMs=GPT-42025.04 | 66.9 | 46.5 | 43.8 | 58.5 | |
| MAG-SQLLLMs=GPT-42025.04 | 65.9 | 46.2 | 41 | 57.6 | |
| CodeSVenue=SIGMOD’24, LLMs=CodeS-15B2025.04 | 65.8 | 48.8 | 42.4 | 58.5 | |
| MAC-SQLVenue=COLING’25, LLMs=GPT-42025.04 | 65.7 | 52.7 | 40.3 | 59.4 | |
| LearNATLLMs=Qwen2.5-Coder-7B2025.04 | 65.4 | 48.4 | 42.4 | 58.1 | |
| CodeSVenue=SIGMOD’24, LLMs=CodeS-7B2025.04 | 64.6 | 46.9 | 40.3 | 57 | |
| DAIL-SQLVenue=VLDB’24, LLMs=GPT-42025.04 | 62.5 | 43.2 | 37.5 | 54.3 | |
| C3-SQLLLMs=GPT-42025.04 | 58.9 | 38.5 | 31.9 | 50.2 |