Natural Language Inference on MultiNLI matched (val)
91.7AccuracyGPT-3 (LoRA)
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-3 (LoRA)Trainable Parameters=4.7M2021.06 | 91.7 | |
| GPT-3 (LoRA)Trainable Parameters=37.7M2021.06 | 91.6 | |
| GPT-3 (Adapter^L)Trainable Parameters=40.1M2021.06 | 91.5 | |
| GPT-3 (BitFit)Trainable Parameters=14.2M2021.06 | 91 | |
| GPT-3 (Adapter^H)Trainable Parameters=7.1M2021.06 | 89.8 | |
| GPT-3 (FT)Trainable Parameters=175,255.8M2021.06 | 89.5 | |
| GPT-3 (PreLayer)Trainable Parameters=20.2M2021.06 | 89.5 | |
| GPT-3 (PreEmbed)Trainable Parameters=3.2M2021.06 | 88.6 |