SCIDOCS
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SCIDOCS
3,353QPS
5
SCIDOCS Full-BEIR
23.1nDCG@10 (baseline)
4
SciDocs
13.4Relative Improvement (%)
4
SCIDOCS
767.05QPS
4
SCIDOCS NanoBEIR (test)
0.396NDCG@10
3
SCIDOCS BEIR
0.52Delta nDCG@10
3
SciDocs
38.1Success Rate
3
SciDocs BEIR
0.12Latency (ms)
2
SciDocs
0.25h2d latency (ms)
1
SciDocs Stratified
99.7MSC
1
SciDocs Aggregate
89.2MSC
1
SciDocs RR
0.861Spearman Correlation
1
SciDocs (test)
—Primary metric
0