Fact Verification on FEVER-Symmetric
88PrecisionRoBERTa-large
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RoBERTa-largeLearning Setting=Supervised, Backbone=RoBERTa-large2021.05 | 88 | 87.9 | 87.8 | |
| BERT-baseLearning Setting=Supervised, Backbone=BERT-base2021.05 | 85.7 | 85.6 | 85.6 | |
| RoBERTa-largeLearning Setting=Supervised, Backbone=RoBERTa-large2021.05 | 85.5 | 85.5 | 85.5 | |
| BERT-baseLearning Setting=Supervised, Backbone=BERT-base2021.05 | 81.5 | 81.3 | 81.2 | |
| QACG (RoBERTa-large)Learning Setting=Zero-shot, Backbone=RoBERTa-large2021.05 | 77.3 | 77 | 77.1 | |
| QACG (BERT-base)Learning Setting=Zero-shot, Backbone=BERT-base2021.05 | 73.2 | 73 | 72.9 | |
| LM as Fact CheckerLearning Setting=Zero-shot2021.05 | 71.2 | 64.5 | 67.8 | |
| QACG (RoBERTa-large)Learning Setting=Zero-shot, Backbone=RoBERTa-large2021.05 | 64.6 | 62 | 62.6 | |
| LM as Fact CheckerLearning Setting=Zero-shot2021.05 | 64.3 | 54.6 | 49.8 | |
| MNLI-TransferLearning Setting=Zero-shot2021.05 | 62.2 | 55.5 | 58.7 | |
| QACG (BERT-base)Learning Setting=Zero-shot, Backbone=BERT-base2021.05 | 56.5 | 55.7 | 55.9 | |
| GPT2 PerplexityLearning Setting=Zero-shot2021.05 | 52.7 | 52.7 | 52.7 | |
| Random GuessLearning Setting=Zero-shot2021.05 | 50 | 50 | 50 | |
| MNLI-TransferLearning Setting=Zero-shot2021.05 | 41.4 | 39.6 | 40.7 | |
| GPT2 PerplexityLearning Setting=Zero-shot2021.05 | 35.3 | 35.3 | 35.3 | |
| Random GuessLearning Setting=Zero-shot2021.05 | 33.3 | 33.3 | 33.3 |