Document Retrieval on MS Marco 300k (dev)
0.6032Hits@1TCT-ColBERT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TCT-ColBERTModel Size=Base2023.05 | 0.6032 | 0.9107 | |
| DSI-QG-MultiModel Size=Large, Task=Index2023.05 | 0.5746 | 0.8868 | |
| DSI-QG-MultiModel Size=Large, Task=Retrv2023.05 | 0.5741 | 0.8754 | |
| DSI-QG-Multi (sem)Model Size=Base, Task=Index, semantic IDs=true2023.05 | 0.5615 | 0.8801 | |
| DSI-QG-Multi (sem)Model Size=Base, Task=Retrv, semantic IDs=true2023.05 | 0.5589 | 0.8659 | |
| DSI-QG-MultiModel Size=Base, Task=Index2023.05 | 0.539 | 0.8726 | |
| NCI (sem)Model Size=Base, Task=Index, semantic IDs=true2023.05 | 0.5289 | 0.8244 | |
| DSI-QG-MultiModel Size=Base, Task=Retrv2023.05 | 0.5219 | 0.848 | |
| DSI-QGModel Size=Large, Task=Index2023.05 | 0.5188 | 0.7589 | |
| DSI-QGModel Size=Base, Task=Index2023.05 | 0.5123 | 0.7703 | |
| BM252023.05 | 0.4404 | 0.7417 | |
| SEALModel Size=Base2023.05 | 0.2322 | 0.5818 | |
| DSIModel Size=Base, Task=Index2023.05 | 0.0218 | 0.0543 | |
| DSIModel Size=Large, Task=Index2023.05 | 0.0214 | 0.0652 |