End-to-end Retrieval on MSMARCO (R@10, R@100, R@1k, Latency)
88Latency (ms)GEM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GEMk (number of returned results)=10, ef_search=8002026.03 | 88 | 71.1 | — | — | |
| GEMk (number of returned results)=100, ef_search=20002026.03 | 140 | — | 91.5 | — | |
| GEMk (number of returned results)=1000, ef_search=80002026.03 | 212 | — | — | 97.5 | |
| PLAIDk (number of returned results)=102026.03 | 222 | 68.8 | — | — | |
| IGPk (number of returned results)=102026.03 | 279 | 66.9 | — | — | |
| MUVERAk (number of returned results)=102026.03 | 286 | 67.7 | — | — | |
| MVGk (number of returned results)=102026.03 | 293 | 69.2 | — | — | |
| DESSERTk (number of returned results)=102026.03 | 298 | 66.2 | — | — | |
| MUVERAk (number of returned results)=1002026.03 | 310 | — | 90.2 | — | |
| DESSERTk (number of returned results)=10002026.03 | 336 | — | — | 97.2 | |
| IGPk (number of returned results)=1002026.03 | 340 | — | 89.5 | — | |
| DESSERTk (number of returned results)=1002026.03 | 344 | — | 89 | — | |
| PLAIDk (number of returned results)=1002026.03 | 352 | — | 91.3 | — | |
| PLAIDk (number of returned results)=10002026.03 | 352 | — | — | 97.5 | |
| MVGk (number of returned results)=1002026.03 | 360 | — | 89.5 | — | |
| IGPk (number of returned results)=10002026.03 | 399 | — | — | 96.9 | |
| MVGk (number of returned results)=10002026.03 | 436 | — | — | 94.2 | |
| MUVERAk (number of returned results)=10002026.03 | 444 | — | — | 97.1 |