Information Retrieval on BEIR and MSMARCO (test)
62.4MSQwen3-8B
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-8BBackbone=Qwen3-Embedding-8B2026.05 | 62.4 | 76.9 | 46 | 91.3 | 38.8 | 92.7 | 64.6 | 77 | 41.3 | 64.6 | 87.8 | 29.7 | 78.4 | 73 | 66 | |
| SSR-CLSBackbone=llama-embed-nemotron-8b, Sparsity Constraint (K)=32, Evaluation Setting=Zero-shot2026.05 | 62 | 76.2 | 46.4 | 90.1 | 43.3 | 94.6 | 62.8 | 77.9 | 46.8 | 68.4 | 88.6 | 29.5 | 82.9 | 70.5 | 67.1 | |
| llama-8BBackbone=llama-embed-nemotron-8b2026.05 | 61.7 | 75.7 | 44.9 | 89.2 | 40.1 | 93.5 | 61.4 | 76.7 | 45.1 | 66.2 | 88.1 | 28.2 | 82 | 68.8 | 65.8 | |
| SSR-tokBackbone=llama-embed-nemotron-8b, Sparsity Constraint (K)=32, Evaluation Setting=Zero-shot2026.05 | 61.2 | 75.4 | 45.5 | 89.6 | 41.5 | 93.9 | 62.1 | 77.2 | 46 | 67.7 | 87.5 | 28.1 | 81.8 | 69.4 | 66.4 | |
| Linq-EmbedEvaluation Setting=Zero-shot2026.05 | 60.5 | 69.6 | 30.3 | 87.1 | 27.8 | 87.6 | 61.2 | 75.4 | 41.1 | 41.9 | 89.2 | 21.9 | 76.4 | 54.5 | 58.9 | |
| e5-mistral-7bEvaluation Setting=Zero-shot2026.05 | 59.1 | 61.7 | 28.5 | 87 | 34.6 | 87 | 56.8 | 73.2 | 33.4 | 66.4 | 88.5 | 16.3 | 75.1 | 55.4 | 58.8 | |
| SFR-EmbedEvaluation Setting=Zero-shot2026.05 | 59 | 67.2 | 28.3 | 87.6 | 27.3 | 86.6 | 60.4 | 73.8 | 40.3 | 34.8 | 88.9 | 19.9 | 76.2 | 55.2 | 57.5 | |
| gte-Qwen2-7BEvaluation Setting=Zero-shot2026.05 | 50.3 | 54.6 | 32.2 | 80.4 | 47.3 | 90.6 | 62 | 75 | 40.4 | 65.6 | 87.9 | 23.5 | 79.5 | 59.2 | 60.6 | |
| bge-large-v1.5Evaluation Setting=Zero-shot2026.05 | 48.7 | 64.5 | 27.3 | 74.7 | 41.9 | 87.3 | 45 | 75 | 37.1 | 51.1 | 88.9 | 22.6 | 73.6 | 47.1 | 56.1 |