Sparse Retrieval Efficiency on MSMARCO v1 (test)
156Latency @ 90% Acc (µs)DotVByte
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DotVByteEncoder=SPLADE, Numeric representation=fixedU82026.02 | 156 | 305 | 482 | — | 4.2 | |
| UncompressedEncoder=SPLADE, Numeric representation=float162026.02 | 157 | 289 | 387 | 1,081 | 5.8 | |
| DotVByteEncoder=SPLADE, Numeric representation=float162026.02 | 165 | 309 | 412 | 1,082 | 5.1 | |
| UncompressedEncoder=SPLADE, Numeric representation=fixedU82026.02 | 185 | 290 | 485 | — | 4.8 | |
| StreamVByteEncoder=SPLADE, Numeric representation=fixedU82026.02 | 402 | 768 | 1,288 | — | 4.2 | |
| StreamVByteEncoder=SPLADE, Numeric representation=float162026.02 | 425 | 818 | 1,168 | 3,146 | 5.2 | |
| UncompressedEncoder=LiLSR, Numeric representation=float162026.02 | 518 | 773 | 773 | 1,658 | 17.5 | |
| DotVByteEncoder=LiLSR, Numeric representation=float162026.02 | 529 | 788 | 788 | 1,643 | 14.9 | |
| DotVByteEncoder=LiLSR, Numeric representation=fixedU82026.02 | 662 | 728 | 822 | — | 11.7 | |
| UncompressedEncoder=LiLSR, Numeric representation=fixedU82026.02 | 670 | 734 | 734 | — | 14.3 | |
| ZetaEncoder=SPLADE, Numeric representation=fixedU82026.02 | 825 | 1,702 | 2,881 | — | 3.8 | |
| ZetaEncoder=SPLADE, Numeric representation=float162026.02 | 848 | 1,616 | 2,343 | 6,243 | 4.8 | |
| StreamVByteEncoder=LiLSR, Numeric representation=float162026.02 | 2,019 | 3,123 | 3,123 | 6,493 | 15.4 | |
| StreamVByteEncoder=LiLSR, Numeric representation=fixedU82026.02 | 2,386 | 2,559 | 2,943 | — | 12.2 | |
| ZetaEncoder=LiLSR, Numeric representation=float162026.02 | 8,220 | 12,093 | 12,093 | 25,401 | 13.2 | |
| ZetaEncoder=LiLSR, Numeric representation=fixedU82026.02 | 11,363 | 11,889 | 13,196 | — | 10.1 |