Multi-turn Text-to-SQL on MMSQL (test)
67TDEXGPT-4 Turbo
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-4 Turbosetting=zero-shot2024.12 | 67 | 30.2 | 70 | 51 | 5.8 | |
| Gemini-1.5 Flashsetting=zero-shot2024.12 | 65.8 | 30.1 | 70 | 52.3 | 4.03 | |
| GPT-3.5 Turbosetting=zero-shot2024.12 | 64.1 | 25.5 | 69.6 | 47.3 | 4.74 | |
| Llama3-8Bsetting=zero-shot2024.12 | 64 | 20.1 | 66.1 | 45.7 | 4.55 | |
| Llama3-70Bsetting=zero-shot2024.12 | 62.8 | 22.8 | 66.4 | 47.4 | 3.86 | |
| SQLCoder-8Bsetting=zero-shot, base_model=Llama-32024.12 | 30.7 | 24.8 | 63.2 | 31 | 3.43 | |
| Codellama-7Bsetting=zero-shot2024.12 | 30.7 | 3.4 | 27.2 | 21.7 | 5.09 | |
| Mistral-7B-v0.2setting=zero-shot2024.12 | 26.4 | 0.7 | 13.7 | 11.2 | 4.37 |