Multi-turn Text-to-SQL on CoSQL (dev)
63.98Query-level EMgpt-oss-20b + Rose-SQL
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| gpt-oss-20b + Rose-SQLLearning Strategy=In-Context Learning2026.05 | 63.98 | 77.52 | 72.21 | 37.36 | 53.82 | 46.53 | |
| Qwen3-8B + Rose-SQLLearning Strategy=In-Context Learning2026.05 | 63.16 | 74.48 | 68.62 | 36.18 | 50.85 | 41.3 | |
| gpt-oss-20bLearning Strategy=In-Context Learning2026.05 | 62.68 | 70.85 | 64.86 | 31.67 | 41.61 | 30.19 | |
| Qwen3-14B + Rose-SQLLearning Strategy=In-Context Learning2026.05 | 62.26 | 77.36 | 72.19 | 37.88 | 53.92 | 47.09 | |
| RASAT + PICARDLearning Strategy=Fine-tuned2026.05 | 58.8 | 67 | — | 27 | 39.6 | — | |
| Qwen3-14BLearning Strategy=In-Context Learning2026.05 | 58.78 | 70.19 | 63.14 | 27.64 | 42.32 | 32.76 | |
| Track-SQLLearning Strategy=Fine-tuned2026.05 | 58.19 | 71.1 | 65.54 | 28.67 | 45.05 | 36.17 | |
| QDA-SQLLearning Strategy=Fine-tuned2026.05 | 57.3 | — | — | 30 | — | — | |
| Qwen3-8BLearning Strategy=In-Context Learning2026.05 | 56.5 | 65.32 | 60.66 | 25.94 | 34.57 | 30.38 | |
| HIE-SQL + GraPPaLearning Strategy=Fine-tuned2026.05 | 56.4 | — | — | 28.7 | — | — | |
| Qwen3-4B + Rose-SQLLearning Strategy=In-Context Learning2026.05 | 55.61 | 72.39 | 66.27 | 29.01 | 45.39 | 38.57 | |
| Qwen3-4BLearning Strategy=In-Context Learning2026.05 | 54.2 | 62.07 | 56.11 | 27.3 | 31.06 | 25.25 | |
| CoE-SQLLearning Strategy=In-Context Learning2026.05 | 52.4 | 69.6 | 60.6 | 23.9 | 39.6 | 30.4 | |
| ACT-SQLLearning Strategy=In-Context Learning2026.05 | 46 | 63.7 | 55.2 | 13.3 | 30.7 | 21.5 | |
| DeepSeek-R1-Distill-Llama-8B + Rose-SQLLearning Strategy=In-Context Learning2026.05 | 39.7 | 59.17 | 52.07 | 13.19 | 26.99 | 19.86 | |
| DeepSeek-R1-Distill-Llama-8BLearning Strategy=In-Context Learning2026.05 | 32.94 | 47.36 | 42.62 | 9.95 | 17.27 | 13.91 |