Text Embedding Evaluation on MTEB English v2 (test)
67.95Average ScoreFP16 teacher
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| FP16 teacherBackbone=Qwen3-0.6B2026.06 | 67.95 | 55.34 | 43.89 | 55.48 | 82.56 | 86.37 | 81.15 | 31.87 | — | 364.36 | |
| BITEMBEDBackbone=Qwen3-0.6B2026.06 | 67.6 | 54.03 | 43.41 | 55.42 | 82.3 | 86.49 | 81.15 | 32.06 | — | 830.5 | |
| Mistral 7B v0.1Fine-tuned=true2026.04 | 67.3 | — | — | — | — | — | — | — | 63.3 | — | |
| FP16 teacherBackbone=Gemma3-270M2026.06 | 66.71 | 52.97 | 43.38 | 53.85 | 80.67 | 86.54 | 80.57 | 28.36 | — | 1,181.28 | |
| BITEMBEDBackbone=Gemma3-270M2026.06 | 66.1 | 51.47 | 42.14 | 53.07 | 80.47 | 85.25 | 81.09 | 32.97 | — | 2,055.47 | |
| Qwen2 1.5BFine-tuned=true2026.04 | 65.7 | — | — | — | — | — | — | — | 62.3 | — | |
| Codestral Mamba2 7BFine-tuned=true, Architecture=Recurrent (embed-mamba2)2026.04 | 65.2 | — | — | — | — | — | — | — | 61.8 | — | |
| Mamba2 1.3BFine-tuned=true, Architecture=Recurrent (embed-mamba2)2026.04 | 64.3 | — | — | — | — | — | — | — | 60.9 | — | |
| LLM2VEC-GENBackbone=Qwen-3-8B2026.03 | 62.1 | 42.2 | 46.7 | 50.3 | 80.8 | 79.1 | 80.3 | 31.9 | — | — | |
| LLM2VEC-GENBackbone=Qwen-3-4B2026.03 | 59.9 | 38 | 45.2 | 50.9 | 78.5 | 76.6 | 77.9 | 28.5 | — | — | |
| LLM2VEC-GENBackbone=Qwen-3-1.7B2026.03 | 58.6 | 37 | 44.9 | 49.3 | 75.6 | 74.4 | 77.3 | 29 | — | — | |
| LLM2VecBackbone=Qwen-3-4B2026.03 | 56.8 | 41.1 | 40 | 43 | 78.5 | 72.5 | 71.6 | 31.1 | — | — | |
| LLM2VecBackbone=Qwen-3-8B2026.03 | 56.8 | 42.7 | 40.9 | 40.6 | 77.3 | 72.5 | 72.6 | 31.7 | — | — | |
| GIRCSEBackbone=Qwen-3-8B2026.03 | 56.5 | 36.3 | 41.3 | 50.9 | 74.7 | 74.2 | 68.8 | 26.6 | — | — | |
| LLM2VecBackbone=Qwen-3-1.7B2026.03 | 54.8 | 34.9 | 39.9 | 41.1 | 76.4 | 71.1 | 73.4 | 30.4 | — | — | |
| GIRCSEBackbone=Qwen-3-1.7B2026.03 | 52.5 | 27.3 | 40.4 | 47.2 | 78.2 | 70.6 | 66.6 | 22.2 | — | — | |
| GIRCSEBackbone=Qwen-3-4B2026.03 | 51.3 | 27.8 | 42.9 | 45.1 | 70.7 | 71.5 | 63.6 | 22.5 | — | — | |
| InBedderBackbone=Qwen-3-8B2026.03 | 50.5 | 11 | 42.4 | 48.6 | 70.7 | 80.5 | 67.4 | 24.5 | — | — | |
| InBedderBackbone=Qwen-3-1.7B2026.03 | 50.2 | 15.7 | 41.2 | 47 | 68.6 | 79.2 | 65.9 | 9.3 | — | — | |
| InBedderBackbone=Qwen-3-4B2026.03 | 50.1 | 13.4 | 41.8 | 48.1 | 68.8 | 79.6 | 64.9 | 26.1 | — | — | |
| HyDEBackbone=Qwen-3-1.7B2026.03 | 49.8 | 17.7 | 39.5 | 38.2 | 69.4 | 75.6 | 72.2 | 18 | — | — | |
| HyDEBackbone=Qwen-3-8B2026.03 | 48.3 | 15.9 | 37.1 | 32.4 | 65.8 | 81.6 | 67.4 | 30.3 | — | — | |
| HyDEBackbone=Qwen-3-4B2026.03 | 44.7 | 14 | 36.9 | 36.4 | 47.5 | 79.9 | 57.9 | 26.7 | — | — | |
| EchoBackbone=Qwen-3-4B2026.03 | 43.6 | 7.6 | 38.7 | 39.7 | 64.1 | 73.5 | 58.7 | 7.6 | — | — | |
| EchoBackbone=Qwen-3-8B2026.03 | 41.8 | 6.8 | 40 | 37.2 | 63.6 | 74.2 | 53.9 | 0.5 | — | — | |
| EchoBackbone=Qwen-3-1.7B2026.03 | 39.8 | 4.4 | 37.7 | 38.1 | 59.3 | 70.4 | 52.1 | 0.8 | — | — |