Passage Ranking on MS MARCO 100K passages
89.2MRR@10GPUSparse
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPUSparseDocs=100K, Per-Q=15๐s, HW=H1002026.06 | 89.2 | 91.2 | 99.8 | |
| cuSPARSE SpMVDocs=100K, Per-Q=46.2ms, HW=H1002026.06 | 88.8 | 90.9 | 99.8 | |
| torch.compileDocs=100K, Per-Q=23.9ms, HW=H1002026.06 | 88.8 | 90.9 | 99.8 | |
| Dense MatMulDocs=100K, Per-Q=117๐s, HW=H1002026.06 | 88.8 | 90.9 | 99.8 | |
| Pyserini BM25Docs=100K, Per-Q=25.2ms, HW=CPU2026.06 | 70.2 | 73.5 | 97.3 |