ArguAna
Benchmarks
TaskDatasetSOTA resultTrendResults
ArguAna
0Attack Success Rate (ASR)
63
ArguAna BEIR
84.9NDCG@10
35
ArguAna
66.15nDCG@10
31
ArguAna
41.6NDCG@10 (Dense)
21
ArguAna BEIR
36.59NDCG@10
19
ArguAna BEIR v1 (test)
0.67nDCG@10
12
Arguana BEIR
90nDCG
11
ArguAna
6,924QPS
9
ArguAna (test)
49.1NDCG@10
9
ArguAna
77.1Precision
8
ArguAna
55.6Hit Rate
7
ArguAna
65.07Accuracy
6
ArguAna out-of-domain (test)
53.3nDCG@10
5
ArguAna nanoBEIR slice
72.97nDCG@10
4
ArguAna Arguments
99.5MRR
4
ArguAna
29.8Relative Improvement (%)
4
ArguAna
36.45nDCG@10
3
ArguAna BEIR v1.0 (test)
38.78nDCG@10
2
ArguAna BEIR
0.24Latency (ms)
2
ArguAna
6.72H2D Latency (ms)
1