Passage Retrieval on MS MARCO (dev)
43.1MRR@10LLaMA2-Llama2Vec
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLaMA2-Llama2VecSize=7B, FT.=hard2023.12 | 43.1 | 99.5 | |
| RetroMAEv2+distllSize=110M, FT.=distill2023.12 | 42.6 | 98.9 | |
| RetroMAE+distillSize=110M, FT.=distill2023.12 | 41.6 | 98.8 | |
| LLaMA2-RepLLaMASize=7B, FT.=hard2023.12 | 41.2 | 99.4 | |
| SimLM+distillSize=110M, FT.=distill2023.12 | 41.1 | 98.7 | |
| AR2+SimANSSize=110M, FT.=distill2023.12 | 40.9 | 98.7 | |
| RetroMAESize=110M, FT.=hard2023.12 | 39.3 | 98.5 | |
| SimLMSize=110M, FT.=hard2023.12 | 39.1 | 98.6 | |
| RocketQAv2FT.=distill2023.12 | 38.8 | 98.1 | |
| GTR-XXLSize=4.8B2023.12 | 38.8 | 99 | |
| coCondenserSize=110M, FT.=hard2023.12 | 38.2 | 98.4 | |
| CondenserSize=110M, FT.=hard2023.12 | 36.6 | 97.4 | |
| ADORESize=110M, FT.=hard2023.12 | 34.7 | — | |
| OpenAI-Ada-0022023.12 | 34.4 | 98.6 | |
| TAS-BSize=55M, FT.=distill2023.12 | 34.3 | 97.6 | |
| ANCESize=125M, FT.=hard2023.12 | 33 | 95.9 | |
| BM252023.12 | 18.4 | 85.3 |