Text-to-SQL on Spider 600 Q (test dev)
73.83Execution AccuracyGemini 2.5 F-Lite
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 2.5 F-LiteTraining Method=Standard SFT, Dataset Size=Full Spider, Hyperparameters=Ep: 3, LRM: 5e-5, Adpt: 162026.03 | 73.83 | |
| Gemini 2.5 FlashTraining Method=Zero-shot, Dataset Size=N/A, Hyperparameters=N/A2026.03 | 73.17 | |
| Gemini 2.5 F-LiteTraining Method=Zero-shot, Dataset Size=N/A, Hyperparameters=N/A2026.03 | 73 | |
| Gemini 2.5 FlashTraining Method=Standard SFT, Dataset Size=Full Spider, Hyperparameters=Ep: 3, LRM: 1, Adpt: 162026.03 | 72.5 | |
| Qwen-CoTBase Model=Qwen (7b), Training Method=CoT Fine-Tune, Dataset Size=Spider + CoT, Hyperparameters=Ep: 5, LRM: 2e-5, Adpt: 322026.03 | 54.5 | |
| Qwen (7b)Training Method=Standard SFT, Dataset Size=Full Spider, Hyperparameters=Ep: 3, LRM: 2e-5, Adpt: 162026.03 | 45.33 | |
| Qwen (7b)Training Method=Zero-shot, Dataset Size=N/A, Hyperparameters=N/A2026.03 | 36.17 |