FEVER
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
FEVER
2.63ASR
15
FEVER
0.737AUROC
15
FEVER
94.3F1 Macro
14
FEVER 1.0 (test)
74.07Label Accuracy
14
FEVER Symmetric v2 1.0
69.1Accuracy
13
FEVER v1 (ID)
87.5Accuracy
13
FEVER
77.2Accuracy
12
FEVER
0Oracle Gap (pp)
12
FEVER
91.9Balanced Accuracy
12
FEVER
85.5NDCG@10
12
FEVER-S
54Accuracy
12
FEVER
61.4Accuracy
12
FEVER
93.1Accuracy
12
FEVER Gold evidence
51.278SARI
11
FEVER
73.73Accuracy
11
FEVER 2018 (test)
88.48Recall@20
10
FEVER (test)
99.7Accuracy
10
FEVER
99.5Precision
10
FEVER v1.0 (dev)
55.1Acc
10
FEVER (test)
72.5Accuracy
10
FEVER
93.8Precision
10
FEVER market scale RAG track (test)
92.6Quality
9
FEVER
78Accuracy
9
FEVER
75.3Online Accuracy (AUC)
9
Symmetric FEVER 1.0 (test)
85.88Accuracy
9