Natural Language Inference on ANLI MNLI + SNLI trained (dev)
50.4Accuracy (A1)FreeLB
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| FreeLBTraining=Adversarial Training, Model=RoBERTa2020.10 | 50.4 | 28 | 28.5 | 35.2 | |
| VanillaTraining=Standard Training, Model=RoBERTa2020.10 | 49.1 | 26.5 | 27.2 | 33.8 | |
| InfoBERTTraining=Adversarial Training, Model=RoBERTa2020.10 | 48.4 | 29.3 | 31.3 | 36 | |
| InfoBERTTraining=Standard Training, Model=RoBERTa2020.10 | 47.8 | 31.2 | 31.8 | 36.6 | |
| InfoBERTTraining=Adversarial Training, Model=BERT2020.10 | 28.3 | 30.2 | 33.8 | 30.9 | |
| InfoBERTTraining=Standard Training, Model=BERT2020.10 | 26 | 30.1 | 31.2 | 29.2 | |
| FreeLBTraining=Adversarial Training, Model=BERT2020.10 | 23 | 29 | 32.2 | 28.3 | |
| VanillaTraining=Standard Training, Model=BERT2020.10 | 20.7 | 26.9 | 31.2 | 26.6 |