SciFact
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SciFact (test)
93Precision (NE)
4
SciFact
80.15NDCG@10
4
SciFact Scientific
98MRR
4
SciFact
4.8Relative Improvement (%)
4
SciFact BEIR (test)
2,585Throughput (QPS)
4
SciFact
86.1Macro Precision
4
SciFact
952.92QPS
4
SciFact
79.9Accuracy
3
SciFact
0.683nDCG@10
3
SciFact k=10 (test)
85Attack Success Rate (ASR)
3
SciFact (dev)
64.7BAcc
3
SciFact BEIR
0.08Latency (ms)
2
SciFact BEIR
0.551MRR@10
1
SciFact
0.12H2D Latency (ms)
1
SciFact 5K docs
0.323Context Precision
1
SciFact
0.861Spearman Correlation
1