Natural Language Inference on MNLI (few-shot/zero-shot)
71.1AccuracyRETROPROMPT
Evaluation results
| Method | Links | |
|---|---|---|
| RETROPROMPTshots=162022.05 | 71.1 | |
| LM-BFFshots=16, demonstration_type=discrete2022.05 | 64.8 | |
| LM-BFFshots=16, demonstration_type=manual2022.05 | 64.3 | |
| KPTshots=16, extra_knowledge=true2022.05 | 61.4 | |
| RETROPROMPTshots=42022.05 | 57.6 | |
| LM-BFFshots=4, demonstration_type=discrete2022.05 | 56.1 | |
| KPTshots=4, extra_knowledge=true2022.05 | 53.7 | |
| RETROPROMPTshots=02022.05 | 53.7 | |
| LM-BFFshots=0, demonstration_type=discrete2022.05 | 52.2 | |
| LM-BFFshots=4, demonstration_type=manual2022.05 | 51 | |
| LOTClassshots=0, training_on_unlabeled=true2022.05 | 50.4 | |
| LM-BFFshots=0, demonstration_type=manual2022.05 | 49.7 | |
| Fine-Tuningshots=162022.05 | 45.8 | |
| KPTshots=0, extra_knowledge=true2022.05 | 37.1 | |
| Fine-Tuningshots=42022.05 | 35 | |
| Fine-Tuningshots=02022.05 | 34.4 |