Document Retrieval on MS Marco 100k (dev)
70.74Hits@1TCT-ColBERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TCT-ColBERTModel Size=Base2023.05 | 70.74 | 95.06 | |
| DSI-QG-Multi (sem)Model Size=Base, Task=Retrv, semantic IDs=true2023.05 | 67.39 | 91.92 | |
| DSI-QG-MultiModel Size=Base, Task=Index2023.05 | 67.11 | 92.08 | |
| DSI-QG-MultiModel Size=Base, Task=Retrv2023.05 | 67.11 | 91.43 | |
| DSI-QG-Multi (sem)Model Size=Base, Task=Index, semantic IDs=true2023.05 | 66.26 | 91.15 | |
| DSI-QG-MultiModel Size=Large, Task=Index2023.05 | 66.25 | 91.3 | |
| DSI-QG-MultiModel Size=Large, Task=Retrv2023.05 | 65.93 | 91.38 | |
| DSI-QGModel Size=Large, Task=Index2023.05 | 61.82 | 80.24 | |
| NCI (sem)Model Size=Base, Task=Index, semantic IDs=true2023.05 | 61.33 | 86.7 | |
| DSI-QGModel Size=Base, Task=Index2023.05 | 60.85 | 80.26 | |
| BM252023.05 | 53.98 | 82.95 | |
| SEALModel Size=Base2023.05 | 28.02 | 62.19 | |
| DSIModel Size=Large, Task=Index2023.05 | 8.74 | 19.48 | |
| DSIModel Size=Base, Task=Index2023.05 | 2.92 | 6.82 |