List your company
ResearchFormerly WizWand

NL-to-SQL on WikiSQL

87.4Execution AccuracyTable-Specialist
30.92845.58960.2574.911Oct 16, 2024
Updated 7mo ago

Evaluation results

MethodLinks
Table-SpecialistBase Model=GPT-4, Training Strategy=Table-Specialist2024.1087.4
GPT-4Base Model=GPT-4, Training Strategy=Vanilla2024.1086.9
Table-SpecialistBase Model=GPT-3.5, Training Strategy=Table-Specialist2024.1085.5
Table-SpecialistBase Model=GPT-4, Training Strategy=Table-Specialist2024.1082.7
GPT-3.5Base Model=GPT-3.5, Training Strategy=Vanilla2024.1082.3
Table-SpecialistBase Model=Llama3.1-8B, Training Strategy=Table-Specialist2024.1081.6
Table-SpecialistBase Model=GPT-4, Training Strategy=Table-Specialist2024.1081.5
Table-SpecialistBase Model=GPT-3.5, Training Strategy=Table-Specialist2024.1079.4
Table-SpecialistBase Model=GPT-3.5, Training Strategy=Table-Specialist2024.1077.6
GPT-4Base Model=GPT-4, Training Strategy=Vanilla2024.1075.9
GPT-4Base Model=GPT-4, Training Strategy=Vanilla2024.1074.5
Table-SpecialistBase Model=Llama3.1-8B, Training Strategy=Table-Specialist2024.1072.8
GPT-3.5Base Model=GPT-3.5, Training Strategy=Vanilla2024.1056.7
Llama3.1-8BBase Model=Llama3.1-8B, Training Strategy=Vanilla2024.1052.5
GPT-3.5Base Model=GPT-3.5, Training Strategy=Vanilla2024.1051
Table-SpecialistBase Model=Llama3.1-8B, Training Strategy=Table-Specialist2024.1040.9
Llama3.1-8BBase Model=Llama3.1-8B, Training Strategy=Vanilla2024.1035.9
Llama3.1-8BBase Model=Llama3.1-8B, Training Strategy=Vanilla2024.1033.1