Multilingual Information Retrieval on MLIR Benchmarks zero-shot
96.29Belebele ScoreQwen3-Embedding-8B (Teacher)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen3-Embedding-8B (Teacher)Size=8B, Evaluation Setting=zero-shot2026.05 | 96.29 | 69.28 | 95.02 | 50.88 | 68.87 | 55.35 | 72.62 | |
| MIMOSize=0.6B, Evaluation Setting=zero-shot2026.05 | 84.18 | 49.83 | 86.05 | 47.06 | 55.4 | 41.62 | 60.69 | |
| bge-m3Size=0.6B, Evaluation Setting=zero-shot2026.05 | 84.02 | 57.33 | 89.89 | 43.77 | 43.19 | 40.03 | 59.71 | |
| Qwen3-Embedding-0.6BSize=0.6B, Evaluation Setting=zero-shot2026.05 | 81.16 | 55.88 | 86.52 | 43.1 | 59.35 | 48.19 | 62.37 | |
| nomic-embed-text-v2-moeSize=0.5B, Evaluation Setting=zero-shot2026.05 | 78.52 | 53.82 | 84.66 | 43.9 | 47.67 | 46.22 | 59.13 | |
| multilingual-e5-largeSize=0.6B, Evaluation Setting=zero-shot2026.05 | 61.51 | 43.01 | 69.98 | 30.87 | 9.69 | 18.55 | 38.93 | |
| gte-Qwen2-1.5B-InstructSize=1.5B, Evaluation Setting=zero-shot2026.05 | 56.71 | 30.39 | 56.45 | 8.7 | 33.42 | 19.48 | 34.19 | |
| multilingual-e5-large-instructSize=0.6B, Evaluation Setting=zero-shot2026.05 | 40.76 | 35.81 | 48.6 | 24.27 | 55.52 | 49.28 | 42.37 |