SciFact
Benchmarks
TaskDatasetSOTA resultTrendResults
SciFact
0ASR
69
SciFact (test)
0.906NDCG@10
65
SciFact
77.77nDCG@10
51
SciFact (test)
76.17Macro-F1
37
SCIFACT
56.3CCL
36
SciFact BEIR
99.36NDCG@10
36
SciFact BEIR (test)
76.6nDCG@10
36
SciFact
74Comprehensiveness
33
SciFact
83.03Macro F1
25
SciFact (test)
84Accuracy
21
SciFact Retrieved evidence
41.709SARI Score
21
SciFact
77.3NDCG@10 (Dense)
21
scifact
96.7Recall@100
19
SciFact
67Faithfulness
18
SciFact BEIR
0.8Delta nDCG@10
16
SciFact
0.77nDCG@10
16
SciFact Sentence
0.359Spearman Correlation
15
Scifact
82nDCG
15
SCIFact
90.3Balanced Acc
15
SCIFACT Full
88.19SUP F1
14
SciFact NanoBEIR (test)
81.7NDCG@10
12
SCIFACT abstract-level (test)
89.9Support F1
12
SciFact
76.4nDCG
12
SciFact
0.91AUROC
12
SciFact BEIR v1 (test)
0.64nDCG@10
12