Retrieval on MS MARCO v1
0.5Retrieval Latency (ms)Double-encoder - Seismic (Half-precision)
Evaluation Results
| Method | Links | |
|---|---|---|
| Double-encoder - Seismic (Half-precision)Bytes=256, Target MRR@10=0.392026.01 | 0.5 | |
| Double-encoder - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3922026.01 | 0.5 | |
| Double-encoder - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3942026.01 | 0.5 | |
| Double-encoder - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3962026.01 | 0.7 | |
| Double-encoder - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.392026.01 | 1 | |
| Double-encoder - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.3922026.01 | 1 | |
| Double-encoder - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.3942026.01 | 1.3 | |
| Double-encoder - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3982026.01 | 1.5 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.392026.01 | 1.5 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3922026.01 | 1.5 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3942026.01 | 1.5 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3962026.01 | 1.5 | |
| Li-Lsr - Seismic (Half-precision)Bytes=256, Target MRR@10=0.392026.01 | 1.5 | |
| Li-Lsr - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3922026.01 | 1.5 | |
| Li-Lsr - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3942026.01 | 1.7 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.392026.01 | 2.3 | |
| Li-Lsr - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3962026.01 | 2.3 | |
| Li-Lsr - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.392026.01 | 2.3 | |
| Double-encoder - kANNolo (JMPQ16)Bytes=20, Target MRR@10=0.392026.01 | 2.4 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3982026.01 | 2.4 | |
| Li-Lsr - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.392026.01 | 2.4 | |
| Li-Lsr - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3922026.01 | 2.4 | |
| Li-Lsr - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3942026.01 | 2.4 | |
| Double-encoder - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3992026.01 | 2.5 | |
| Li-Lsr - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3962026.01 | 2.6 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.3922026.01 | 2.8 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.392026.01 | 2.8 | |
| Double-encoder - kANNolo (JMPQ16)Bytes=20, Target MRR@10=0.3922026.01 | 2.9 | |
| Li-Lsr - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.3922026.01 | 2.9 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.3942026.01 | 3 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.3922026.01 | 3 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.3942026.01 | 3.4 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.3962026.01 | 4.1 | |
| Double-encoder - kANNolo (JMPQ16)Bytes=20, Target MRR@10=0.3942026.01 | 4.2 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.3962026.01 | 4.2 | |
| Li-Lsr - Seismic (Half-precision)Bytes=256, Target MRR@10=0.3982026.01 | 5.4 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.3982026.01 | 5.5 | |
| Li-Lsr - Seismic (JMPQ32)Bytes=36, Target MRR@10=0.3982026.01 | 5.7 | |
| Li-Lsr - Seismic (JMPQ16)Bytes=20, Target MRR@10=0.3942026.01 | 5.8 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.3982026.01 | 6.2 | |
| Double-encoder - kANNolo (JMPQ16)Bytes=20, Target MRR@10=0.3962026.01 | 6.6 | |
| Double-encoder - kANNolo (JMPQ32)Bytes=36, Target MRR@10=0.3992026.01 | 8.1 | |
| Double-encoder - kANNolo (Half-precision)Bytes=256, Target MRR@10=0.3992026.01 | 8.7 | |
| TachiomTarget MRR@10=39.02026.04 | 10 | |
| TachiomTarget MRR@10=39.32026.04 | 14 | |
| TachiomTarget MRR@10=39.62026.04 | 15 | |
| EmvbTarget MRR@10=39.02026.04 | 55 | |
| Emvb (JMPQ16)Bytes=20, Target MRR@10=0.392026.01 | 56 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.392026.01 | 56 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.3922026.01 | 56 | |
| EmvbTarget MRR@10=39.32026.04 | 56 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.3942026.01 | 56.4 | |
| Emvb (JMPQ16)Bytes=20, Target MRR@10=0.3922026.01 | 56.7 | |
| EmvbTarget MRR@10=39.62026.04 | 57 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.3962026.01 | 57.3 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.3982026.01 | 59.4 | |
| Emvb (JMPQ16)Bytes=20, Target MRR@10=0.3942026.01 | 61.4 | |
| Emvb (JMPQ32)Bytes=36, Target MRR@10=0.3992026.01 | 67.1 | |
| IgpTarget MRR@10=39.02026.04 | 72 | |
| IgpBytes=36, Target MRR@10=0.392026.01 | 72.8 | |
| WarpTarget MRR@10=39.02026.04 | 98 | |
| WarpTarget MRR@10=39.32026.04 | 98 | |
| WarpBytes=35, Target MRR@10=0.392026.01 | 98.7 | |
| WarpBytes=35, Target MRR@10=0.3922026.01 | 98.7 | |
| IgpBytes=36, Target MRR@10=0.3922026.01 | 110 | |
| WarpBytes=35, Target MRR@10=0.3942026.01 | 136.3 |