Information Retrieval on MTEB (test)
0.677MRR (Avg Med)STM_Phi4
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| STM_Phi4Size=3.8B2026.02 | 0.677 | — | — | — | — | — | — | — | 0.603 | 0.646 | |
| E5 Large V2Size=335M2026.02 | 0.654 | — | — | — | — | — | — | — | 0.576 | 0.622 | |
| STM_GemmaSize=2B2026.02 | 0.654 | — | — | — | — | — | — | — | 0.577 | 0.622 | |
| BMRetrieverSize=2B2026.02 | 0.645 | — | — | — | — | — | — | — | 0.56 | 0.609 | |
| STM_Qwen3Size=0.6B2026.02 | 0.638 | — | — | — | — | — | — | — | 0.585 | 0.616 | |
| LLM2VecSize=3B2026.02 | 0.635 | — | — | — | — | — | — | — | 0.597 | 0.619 | |
| GTR T5 XLSize=1.2B2026.02 | 0.581 | — | — | — | — | — | — | — | 0.586 | 0.583 | |
| BM252026.02 | 0.532 | — | — | — | — | — | — | — | 0.515 | 0.525 | |
| ContrieverSize=150M2026.02 | 0.508 | — | — | — | — | — | — | — | 0.533 | 0.519 | |
| MPNETModel Variant=MPNET-QA2024.06 | — | 0.656 | 0.542 | 0.56 | 0.622 | 0.352 | 0.539 | 0.868 | — | — | |
| MrRank2024.06 | — | 0.669 | 0.546 | 0.56 | 0.634 | 0.663 | 0.539 | 0.877 | — | — | |
| SGPTModel Variant=SGPT-125M-msmarco2024.06 | — | 0.264 | 0.151 | 0.12 | 0.234 | 0.425 | 0.13 | 0.797 | — | — |