NL-to-Scala on Text2Analysis
37.3Execution AccuracyTable-Specialist
Evaluation Results
| Method | Links | |
|---|---|---|
| Table-SpecialistBase Model=GPT-3.5, Training Strategy=Table-Specialist2024.10 | 37.3 | |
| Table-SpecialistBase Model=GPT-4, Training Strategy=Table-Specialist2024.10 | 37.3 | |
| GPT-4Base Model=GPT-4, Training Strategy=Vanilla2024.10 | 25.8 | |
| GPT-3.5Base Model=GPT-3.5, Training Strategy=Vanilla2024.10 | 23.6 | |
| Table-SpecialistBase Model=Llama3.1-8B, Training Strategy=Table-Specialist2024.10 | 21.4 | |
| Llama3.1-8BBase Model=Llama3.1-8B, Training Strategy=Vanilla2024.10 | 12.9 |