Text-to-SQL on WikiSQL (val)
74AccuracyGPT-3 (LoRA)
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-3 (LoRA)Trainable Parameters=37.7M2021.06 | 74 | |
| GPT-3 (FT)Trainable Parameters=175,255.8M2021.06 | 73.8 | |
| GPT-3 (LoRA)Trainable Parameters=4.7M2021.06 | 73.4 | |
| GPT-3 (Adapter^L)Trainable Parameters=40.1M2021.06 | 73.2 | |
| GPT-3 (Adapter^H)Trainable Parameters=7.1M2021.06 | 71.9 | |
| GPT-3 (BitFit)Trainable Parameters=14.2M2021.06 | 71.3 | |
| GPT-3 (PreLayer)Trainable Parameters=20.2M2021.06 | 70.1 | |
| GPT-3 (PreEmbed)Trainable Parameters=3.2M2021.06 | 63.1 |