Fact Verification on FEVER (test)
79.47LA ScoreProoFVer-SB
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ProoFVer-SBRetriever=Stammbach (2021)2021.08 | 79.47 | 76.82 | — | — | |
| ProoFVerRetriever=Liu et al. (2020)2021.08 | 79.25 | 74.37 | — | — | |
| DominikSRetriever=Stammbach (2021)2021.08 | 79.16 | 76.78 | — | — | |
| ProoFVer-ARetriever=Liu et al. (2020)2021.08 | 77.16 | 72.47 | — | — | |
| DREAMBackbone=XLNet-Large2023.09 | 76.85 | — | — | — | |
| DOMLIN++Backbone=RoBERTa-Large2023.09 | 76.6 | — | — | — | |
| CorefBERTRetriever=Liu et al. (2020)2021.08 | 75.96 | 72.3 | — | — | |
| ROBERTaBase Flexible (IE1) + MSPP (REk)Backbone=RoBERTa-Base, Sequence Type=Flexible, Prediction Head=IE1, MSPP Pre-training=REk2023.09 | 75.36 | — | — | — | |
| Joint Pre IEk + FT IE1Pre-training head=IEk, Fine-tuning head=IE12022.05 | 74.39 | — | — | — | |
| ROBERTaBase Fixed (IE1) + MSPP (IEk)Backbone=RoBERTa-Base, Sequence Type=Fixed, Prediction Head=IE1, MSPP Pre-training=IEk2023.09 | 74.39 | — | — | — | |
| Joint Pre IEk + FT AE1Pre-training head=IEk, Fine-tuning head=AE12022.05 | 74.25 | — | — | — | |
| ProoFVer-MVRetriever=Liu et al. (2020)2021.08 | 74.18 | 70.09 | — | — | |
| Joint Pre AEk + FT AE1Pre-training head=AEk, Fine-tuning head=AE12022.05 | 74.13 | — | — | — | |
| ROBERTaBase Fixed (AE1) + MSPP (AEk)Backbone=RoBERTa-Base, Sequence Type=Fixed, Prediction Head=AE1, MSPP Pre-training=AEk2023.09 | 74.13 | — | — | — | |
| KGATBackbone=RoBERTa-Base2022.05 | 74.07 | — | — | — | |
| KGATRetriever=Liu et al. (2020)2021.08 | 74.07 | 70.38 | — | — | |
| KGAT with RoBERTaBaseBackbone=RoBERTa-Base2023.09 | 74.07 | — | — | — | |
| Joint Pre AEk + FT IE1Pre-training head=AEk, Fine-tuning head=IE12022.05 | 73.77 | — | — | — | |
| Joint RoBERTa-Base + FT IE1Approach=Joint, Backbone=RoBERTa-Base, Fine-tuning head=IE12022.05 | 73.56 | — | — | — | |
| ROBERTaBase Flexible (IE1)Backbone=RoBERTa-Base, Sequence Type=Flexible, Prediction Head=IE1, MSPP Pre-training=false2023.09 | 73.56 | — | — | — | |
| ROBERTaBase Fixed (IE1)Backbone=RoBERTa-Base, Sequence Type=Fixed, Prediction Head=IE1, MSPP Pre-training=false2023.09 | 73.01 | — | — | — | |
| ROBERTaBase Fixed (AE1)Backbone=RoBERTa-Base, Sequence Type=Fixed, Prediction Head=AE1, MSPP Pre-training=false2023.09 | 72.94 | — | — | — | |
| Transformer-XH2022.05 | 72.39 | — | — | — | |
| Transformer-XH2023.09 | 72.39 | — | — | — | |
| GEAR2019.07 | 71.6 | 67.1 | — | — | |
| GEAR2022.05 | 71.6 | — | — | — | |
| GEAR2023.09 | 71.6 | — | — | — | |
| BERT Concat2019.07 | 71.01 | 65.64 | — | — | |
| BERT Pair2019.07 | 69.75 | 65.18 | — | — | |
| UNC NLP2019.07 | 68.21 | 64.21 | — | — | |
| UCL MRG2019.07 | 67.62 | 62.52 | — | — | |
| Athene2019.07 | 65.46 | 61.58 | — | — | |
| ATLASshots=15-shot, approach=fine-tuning2022.08 | — | — | 56.2 | — | |
| ATLASshots=65-shot, approach=fine-tuning2022.08 | — | — | 64.3 | — | |
| ATLASshots=Full dataset, approach=fine-tuning2022.08 | — | — | 78 | — | |
| ATLASshots=Full dataset, approach=fine-tuning, index=FEVER Wikipedia corpus2022.08 | — | — | 80.1 | — | |
| DiffuTruth2026.02 | — | — | — | 64 | |
| Direct NLI2026.02 | — | — | — | 71 | |
| DOMLIN++Retrieval Type=sophisticated2022.05 | — | — | 76.6 | — | |
| DREAMBackbone=XL-Net, Retrieval Type=sophisticated2022.05 | — | — | 76.85 | — | |
| FTK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 36.1 | — | |
| GEAR2022.05 | — | — | 71.6 | — | |
| Gophershots=15-shot, approach=prompting2022.08 | — | — | 51.1 | — | |
| HOK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 20.2 | — | |
| Hybrid2026.02 | — | — | — | 72.5 | |
| Joint BERT-BaseBackbone=BERT-Base, Model Architecture=Joint2022.05 | — | — | 71.01 | — | |
| Joint Pre AEk + FT AE1Backbone=RoBERTa-Base, Model Architecture=Joint, Pre-training Head=AEk, Fine-tuning Head=AE12022.05 | — | — | 74.13 | — | |
| Joint Pre AEk + FT IE1Backbone=RoBERTa-Base, Model Architecture=Joint, Pre-training Head=AEk, Fine-tuning Head=IE12022.05 | — | — | 73.77 | — | |
| Joint Pre IEk + FT AE1Backbone=RoBERTa-Base, Model Architecture=Joint, Pre-training Head=IEk, Fine-tuning Head=AE12022.05 | — | — | 74.25 | — | |
| Joint Pre IEk + FT IE1Backbone=RoBERTa-Base, Model Architecture=Joint, Pre-training Head=IEk, Fine-tuning Head=IE12022.05 | — | — | 74.39 | — | |
| Joint RoBERTa-BaseBackbone=RoBERTa-Base, Model Architecture=Joint, Fine-tuning Head=IE12022.05 | — | — | 73.56 | — | |
| KGATBackbone=RoBERTa-Base2022.05 | — | — | 74.07 | — | |
| LOK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 22.6 | — | |
| MixDAK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 32.6 | — | |
| Pairwise BERT-BaseBackbone=BERT-Base, Model Architecture=Pairwise2022.05 | — | — | 69.75 | — | |
| PFK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 27.4 | — | |
| ProoFVershots=Full dataset2022.08 | — | — | 79.5 | — | |
| PTK=16, backbone=RoBERTa, protocol=few-shot2023.06 | — | — | 31.1 | — | |
| Transformer-XH2022.05 | — | — | 72.39 | — |