SciFact
Benchmarks
TaskDatasetSOTA resultTrendResults
SCIFACT
94.32Accuracy
12
SciFact Gold evidence
42.633SARI
11
SciFact
0.952Recall@10
10
SciFact-G
35.1R@10
10
SciFact
83.63-Class Accuracy
8
SciFact n=323
87.6Sufficiency@5
8
SciFact
83.2Precision
8
SciFact n=322
25.78Sufficiency@10 Delta
7
SciFact
85.1Hit Rate
7
SciFact
72.07NDCG@10
7
SciFact
100Answerability Rate
6
SciFact Gradual pattern
71.8NDCG
6
SciFact Rotation pattern
0.735NDCG
6
SciFact Step pattern
73.2NDCG
6
SciFact
44nDCG@5
6
SciFact EN
32.35nDCG@10
6
SciFact
40.5Accuracy
6
SciFact
29.08Contriever Score
6
SciFact
75.14Accuracy
6
SciFact (test)
98.71MAP
5
SciFact BEIR
0.708nDCG
5
SciFact (val)
71.15Macro-F1
4
SciFact nanoBEIR slice
77.8nDCG@10
4
SciFact
9,920ITC
4
SciFact
0.69AIT (s)
4