List your company
ResearchFormerly WizWand

Text-to-SQL on NL2SQL

53.2Execution AccuracyJsonTuning
-0.67213.31427.341.286Oct 4, 2023
Updated 8mo ago

Evaluation results

MethodLinks
JsonTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.1053.2
TextTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.1053
JsonTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.1031.8
TextTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.1030.8
JsonTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.1026.4
TextTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.1023.2
JsonTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.1021.4
TextTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.1017.8
JsonTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.1016.4
JsonTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.1011.2
TextTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.1010.8
TextTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.108.6
TextTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.102
JsonTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.101.4