Text-to-SQL on NL2SQL
53.2Execution AccuracyJsonTuning
Evaluation Results
| Method | Links | |
|---|---|---|
| JsonTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.10 | 53.2 | |
| TextTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.10 | 53 | |
| JsonTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.10 | 31.8 | |
| TextTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.10 | 30.8 | |
| JsonTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.10 | 26.4 | |
| TextTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.10 | 23.2 | |
| JsonTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.10 | 21.4 | |
| TextTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.10 | 17.8 | |
| JsonTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.10 | 16.4 | |
| JsonTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.10 | 11.2 | |
| TextTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.10 | 10.8 | |
| TextTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.10 | 8.6 | |
| TextTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.10 | 2 | |
| JsonTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.10 | 1.4 |