Text Embedding on MTEB (test)
72.97Average ScoreQwen3-Embedding-8B
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-Embedding-8BDim=4096, Backbone=Qwen-32026.02 | 72.97 | 44.57 | 40.56 | 63.4 | 78.61 | 41.39 | 76.3 | 95.82 | 88.46 | 93.59 | 89.71 | 62.82 | 97.46 | 58.86 | 89.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VA (Qwen3-Embedding-8B)Dim=1024, Backbone=Qwen-32026.02 | 70.89 | 44.29 | 39.97 | 60.4 | 75.16 | 34.48 | 72.71 | 94.15 | 83.94 | 91 | 89.4 | 63.93 | 96.06 | 58.19 | 88.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-Embedding-0.6BDim=1024, Backbone=Qwen-32026.02 | 68.43 | 39.98 | 36.76 | 51.2 | 70.65 | 36.06 | 70.65 | 93.32 | 84.69 | 91.23 | 85.19 | 59.77 | 97.48 | 54.22 | 86.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VA (Qwen3-Embedding-0.6B)Dim=1024, Backbone=Qwen-32026.02 | 66.46 | 39.23 | 36.05 | 49.84 | 68.21 | 32.74 | 67.02 | 89.67 | 80.17 | 87.14 | 84.34 | 59.46 | 96.5 | 54.17 | 85.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Llm2vecDim=4096, Backbone=Llama-22026.02 | 66.11 | 34.81 | 31.37 | 51.04 | 77.3 | 40.33 | 56.53 | 90.63 | 83.01 | 88.72 | 88.17 | 51.71 | 96.83 | 51.02 | 84.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ML-EmbedParameters=0.6B2026.05 | 64.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.3 | 70.01 | 77.27 | 57.58 | 63.4 | 62 | 66.11 | 61.58 | 66.64 | 68.74 | 68.13 | 62.64 | 71.3 | 56.59 | 63.35 | 65.32 | 57.85 | — | — | — | — | — | — | |
| VA (Llm2vec)Dim=4096, Backbone=Llama-22026.02 | 64.21 | 33.87 | 30.73 | 47.82 | 74.95 | 29.51 | 56.98 | 88.48 | 81.12 | 87.07 | 83.32 | 52.75 | 97.07 | 52.31 | 83.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-EmbedParameters=0.6B2026.05 | 64.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.34 | 70.47 | 75.42 | 60.16 | 63.91 | 60.99 | 66.53 | 59.45 | 63.01 | 65.29 | 67.42 | 66.71 | 67.28 | 54.27 | 64.2 | 62.88 | 56.01 | — | — | — | — | — | — | |
| Finetune-VADim=4096, Backbone=Llama-22026.02 | 62.14 | 33.3 | 29.97 | 38.26 | 71.86 | 38.21 | 46.88 | 89.76 | 79.97 | 84.62 | 82.92 | 49.32 | 94.67 | 49.29 | 80.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Finetune-MPDim=4096, Backbone=Llama-22026.02 | 61.28 | 34.41 | 31.19 | 36.69 | 71.47 | 35.56 | 48.81 | 88.19 | 77.71 | 82.83 | 85.77 | 50.55 | 92.28 | 47.87 | 74.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Finetune-VA (Attention Only)Dim=4096, Backbone=Llama-22026.02 | 61.25 | 34.12 | 31.02 | 39.64 | 70.53 | 31.12 | 51.75 | 88.57 | 77.63 | 82.56 | 85.37 | 47.24 | 90.07 | 48.2 | 79.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ML-EmbedParameters=0.3B2026.05 | 61.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 58.06 | 67.99 | 73.94 | 55.91 | 59.8 | 59.22 | 61.87 | 58.48 | 63.59 | 61.71 | 65.65 | 59.38 | 66 | 54.04 | 60.12 | 60.16 | 54.17 | — | — | — | — | — | — | |
| EmbedGemmaParameters=0.3B2026.05 | 59.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.15 | 69.67 | 68.76 | 51.24 | 62.5 | 54.39 | 66.11 | 56.28 | 61.9 | 58.24 | 64.7 | 50.4 | 60.82 | 50.98 | 64.57 | 67.11 | 43.45 | — | — | — | — | — | — | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=ECHO, tau=22026.06 | 57.7 | — | — | — | — | — | — | — | — | 74.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.77 | 42.64 | 73.98 | 53.15 | 39.21 | 28.46 | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=ECHO, tau=42026.06 | 57.32 | — | — | — | — | — | — | — | — | 74.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.13 | 42.28 | 73.94 | 53.07 | 38.64 | 28.97 | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=PromptEOL, tau=22026.06 | 56.79 | — | — | — | — | — | — | — | — | 76.66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.78 | 40.67 | 66.64 | 54.68 | 29.69 | 27.39 | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=PromptEOL, tau=42026.06 | 56.78 | — | — | — | — | — | — | — | — | 76.63 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.73 | 40.57 | 66.63 | 54.65 | 29.86 | 27.51 | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=ECHO, tau=82026.06 | 56.61 | — | — | — | — | — | — | — | — | 74.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.5 | 41.88 | 73.76 | 52.75 | 37.75 | 28.58 | |
| EmbedFilterBackbone=Llama-3.1-8B-Instruct, Base Method=PromptEOL, tau=82026.06 | 56.46 | — | — | — | — | — | — | — | — | 76.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.1 | 40.32 | 66.41 | 54.41 | 29.7 | 27.93 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=ECHO, tau=42026.06 | 56.25 | — | — | — | — | — | — | — | — | 74.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.05 | 37.07 | 74.91 | 51.87 | 35.49 | 31.14 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=ECHO, tau=22026.06 | 56.1 | — | — | — | — | — | — | — | — | 74.66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.79 | 36.14 | 74.96 | 51.66 | 35.03 | 31.23 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=ECHO, tau=82026.06 | 55.82 | — | — | — | — | — | — | — | — | 74.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70 | 36.92 | 74.29 | 51.71 | 34.91 | 31.56 | |
| PromptEOLBackbone=Llama-3.1-8B-Instruct2026.06 | 55.13 | — | — | — | — | — | — | — | — | 75.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.39 | 39.3 | 64.22 | 53.67 | 25.45 | 25.49 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=PromptEOL, tau=22026.06 | 54.57 | — | — | — | — | — | — | — | — | 69.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.32 | 39.2 | 64.72 | 51.28 | 34.73 | 27.12 | |
| ECHOBackbone=Llama-3.1-8B-Instruct2026.06 | 53.52 | — | — | — | — | — | — | — | — | 70.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.8 | 38.89 | 66.98 | 49.26 | 30.14 | 25.41 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=PromptEOL, tau=42026.06 | 53.47 | — | — | — | — | — | — | — | — | 68.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.92 | 38.24 | 64.54 | 50.62 | 32.85 | 27.67 | |
| ECHOBackbone=Mistral-7B-Instruct-v0.32026.06 | 53.21 | — | — | — | — | — | — | — | — | 72.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.6 | 32.42 | 71.48 | 47.56 | 28.37 | 31.49 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=ECHO, tau=22026.06 | 52.55 | — | — | — | — | — | — | — | — | 70.77 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 67.37 | 36.94 | 66.35 | 46.59 | 29.65 | 29.73 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=PromptEOL, tau=82026.06 | 52.35 | — | — | — | — | — | — | — | — | 68.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.07 | 38.04 | 63.67 | 50.2 | 25.92 | 25.79 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=PromptEOL, tau=42026.06 | 52.26 | — | — | — | — | — | — | — | — | 67.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.92 | 37.41 | 63.29 | 50.11 | 25.97 | 24.66 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=ECHO, tau=42026.06 | 51.5 | — | — | — | — | — | — | — | — | 69.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.59 | 36.17 | 65.33 | 46.4 | 28.61 | 31.65 | |
| EmbedFilterBackbone=Mistral-7B-Instruct-v0.3, Base Method=PromptEOL, tau=22026.06 | 51.5 | — | — | — | — | — | — | — | — | 66.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.17 | 36.16 | 62.07 | 49.63 | 24.59 | 24.33 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=PromptEOL, tau=82026.06 | 51.43 | — | — | — | — | — | — | — | — | 68.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 66.07 | 35.5 | 63.57 | 49.7 | 29.82 | 28.37 | |
| VADim=4096, Backbone=Llama-22026.02 | 50.94 | 32.45 | 28.65 | 27.95 | 52.41 | 23.52 | 44.26 | 74.08 | 61.49 | 61.72 | 75.19 | 39.54 | 73.75 | 41.51 | 76.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PromptEOLBackbone=Qwen2.5-0.5B2026.06 | 50.07 | — | — | — | — | — | — | — | — | 63.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.2 | 34.91 | 55.15 | 49.33 | 27.31 | 27.3 | |
| PromptEOLBackbone=Mistral-7B-Instruct-v0.32026.06 | 49.47 | — | — | — | — | — | — | — | — | 64.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.26 | 33.4 | 58.51 | 48.1 | 20.91 | 24.72 | |
| EmbedFilterBackbone=Qwen2.5-0.5B, Base Method=ECHO, tau=82026.06 | 49.43 | — | — | — | — | — | — | — | — | 68.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.91 | 34.8 | 63.57 | 46.13 | 25.42 | 29.79 | |
| ECHOBackbone=Qwen2.5-0.5B2026.06 | 46.03 | — | — | — | — | — | — | — | — | 63.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.86 | 30.16 | 55.54 | 42.8 | 18.15 | 22.78 |