Text Embedding on MTEB
90.4Classification ScoreQwen3-Embedding-8B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-Embedding-8BNumber of parameters=>300M2026.06 | 90.4 | — | 58.3 | 88 | 67.6 | 88.7 | 50.9 | 35.2 | 74.8 | |
| harrier-oss-v1-0.6bNumber of parameters=>300M2026.06 | 88.3 | — | 56.6 | 86.7 | 58.6 | 85.1 | 47 | 31.5 | 70.6 | |
| embeddinggemma-300mNumber of parameters=≤300M2026.06 | 87.5 | — | 53.3 | 84.8 | 54.6 | 82.9 | 46.9 | 37.8 | 68.4 | |
| jina-embeddings-v3Number of parameters=>300M2026.06 | 85.4 | — | 48 | 84 | 52.6 | 85.7 | 48 | 32.9 | 66.9 | |
| SEA-LION-E5-Embedding-600MNumber of parameters=>300M2026.06 | 77.8 | — | 51.1 | 87.4 | 50.2 | 84.8 | 47.1 | 31.6 | 65.5 | |
| SEA-LION-ModernBERT-Embedding-300MNumber of parameters=≤300M2026.06 | 77.6 | — | 48.4 | 83.2 | 44.8 | 81.8 | 44.6 | 27 | 62.4 | |
| bge-m3 (Dense)Number of parameters=>300M2026.06 | 77.4 | — | 40.7 | 84.5 | 49.6 | 80.9 | 46 | 34.8 | 62.2 | |
| harrier-oss-v1-270mNumber of parameters=≤300M2026.06 | 76.5 | — | 47.2 | 81.2 | 41 | 76.6 | 44.4 | 24 | 59.6 | |
| multilingual-e5-large-instructNumber of parameters=>300M2026.06 | 75.3 | — | 51.7 | 86.2 | 53.6 | 84.6 | 46.4 | 30.6 | 65.7 | |
| MetaEOLDimension=40962026.06 | 74.89 | — | 41.31 | 72.5 | 32.16 | 71.23 | 52.44 | 29.87 | 56.73 | |
| MetaEOL + EmbFilterDimension=512, tau=82026.06 | 74.74 | — | 42.47 | 74.55 | 35.89 | 73.49 | 53.39 | 30.72 | 58.25 | |
| ReverseEOLBackbone=LLaMA-2-7B2026.06 | 73.61 | — | 38.64 | 69.67 | 34.15 | — | 59.75 | — | 49.91 | |
| ReverseEOLBackbone=Mistral-7B2026.06 | 73.14 | — | 40.53 | 70.69 | 33.29 | — | 61.56 | — | 50.43 | |
| PromptEOL + EmbFilterDimension=4096, tau=82026.06 | 73.1 | — | 40.32 | 66.41 | 29.7 | 76.33 | 54.41 | 27.93 | 56.46 | |
| ReverseEOLBackbone=LLaMA-2-13B2026.06 | 72.81 | — | 36.95 | 69.03 | 31.95 | — | 60.06 | — | 48.57 | |
| PromptEOL w/ TPBackbone=LLaMA-2-7B2026.06 | 72.8 | — | 34.14 | 64.65 | 29.84 | — | 58.81 | — | 46.56 | |
| HyTE-HParameters=149M, Dimensions=768, Layers=12, Geometry=Hyperbolic2026.02 | 72.71 | 59.89 | 44.83 | 83.82 | 43.56 | 78.38 | 46.01 | 30.87 | 57.15 | |
| PromptEOL w/ CPBackbone=LLaMA-2-7B2026.06 | 72.45 | — | 33.2 | 63.31 | 28.22 | — | 58.41 | — | 45.57 | |
| turkish-base-bert-uncased-RetrievalSource=YTU-CE-Cosmos2026.01 | 72.29 | 57.89 | 43.23 | 61.77 | 47.95 | 64.18 | — | — | — | |
| PromptEOLBackbone=LLaMA-2-7B2026.06 | 71.97 | — | 31.94 | 62.36 | 26.92 | — | 57.94 | — | 44.57 | |
| PromptEOL w/ TPBackbone=LLaMA-2-13B2026.06 | 71.83 | — | 33.17 | 60.82 | 26.28 | — | 59.67 | — | 44.76 | |
| PromptEOL w/ TPBackbone=Mistral-7B2026.06 | 71.71 | — | 35.69 | 61.93 | 28.21 | — | 60.18 | — | 46.22 | |
| ECHOBackbone=LLaMA-2-7B2026.06 | 71.6 | — | 38.06 | 74.04 | 25.73 | — | 59.15 | — | 47.28 | |
| PromptEOLBackbone=Mistral-7B2026.06 | 71.55 | — | 36.21 | 61.09 | 28.06 | — | 60.39 | — | 46.25 | |
| PromptEOL w/ CPBackbone=Mistral-7B2026.06 | 71.43 | — | 35.68 | 60.78 | 27.14 | — | 60.54 | — | 45.79 | |
| PromptEOLBackbone=LLaMA-2-13B2026.06 | 70.87 | — | 31.77 | 57.63 | 25.66 | — | 58.59 | — | 43.54 | |
| PromptEOL w/ CPBackbone=LLaMA-2-13B2026.06 | 70.47 | — | 32.11 | 57.21 | 25.11 | — | 58.7 | — | 43.38 | |
| KV-EmbeddingBackbone=Mistral-7B-Instruct-v0.12026.01 | 69.51 | 53.41 | 39.02 | 75.64 | 30.14 | 77.2 | 51.45 | 30.88 | — | |
| bert-base-turkish-cased-RetrievalSource=dbmdz2026.01 | 69.45 | 56.61 | 42.25 | 60.95 | 49.7 | 60.71 | — | — | — | |
| ModernBert-embed*Parameters=149M, Dimensions=768, Layers=12, Geometry=Euclidean, Note=Euclidean equivalent of HyTE2026.02 | 69.25 | 58.32 | 40.87 | 83.84 | 43.28 | 78 | 44.29 | 28.37 | 55.59 | |
| EucBERTParameters=149M, Dimensions=768, Layers=12, Geometry=Euclidean2026.02 | 69.07 | 54.11 | 35.31 | 80.02 | 37.01 | 75.02 | 35.18 | 27.62 | 51.31 | |
| bert-base-turkish-uncased-RetrievalSource=dbmdz2026.01 | 69.05 | 55.39 | 41.52 | 61.39 | 50.2 | 54.77 | — | — | — | |
| PromptEOLDimension=40962026.06 | 68.8 | — | 38.89 | 66.98 | 30.14 | 70.43 | 49.26 | 25.41 | 53.52 | |
| ECHODimension=40962026.06 | 68.8 | — | 38.89 | 66.98 | 30.14 | 70.43 | 49.26 | 25.41 | 53.52 | |
| HyTE-H (bert)Parameters=149M, Dimensions=768, Layers=12, Variant=bert2026.02 | 68.77 | 56.41 | 41.95 | 79.7 | 40.54 | 74.39 | 42.05 | 28.87 | 53.75 | |
| HyTE-H (Euc)Parameters=149M, Dimensions=768, Layers=12, Variant=Euc2026.02 | 68.76 | 54.57 | 38.67 | 80.02 | 34.26 | 73.33 | 44.54 | 36.45 | 53.71 | |
| ECHOBackbone=LLaMA-2-13B2026.06 | 68.7 | — | 31.98 | 72.03 | 24.77 | — | 53.08 | — | 43.72 | |
| ECHOBackbone=Mistral-7B2026.06 | 68.59 | — | 34.29 | 70.55 | 21.41 | — | 52.02 | — | 43.23 | |
| turkish-large-bert-cased-RetrievalSource=YTU-CE-Cosmos2026.01 | 68.13 | 54.41 | 41.5 | 60.77 | 48.23 | 53.4 | — | — | — | |
| ECHO + EmbFilterDimension=512, tau=82026.06 | 67.5 | — | 41.88 | 73.76 | 37.75 | 74.05 | 52.75 | 28.58 | 56.61 | |
| Mursit-Large-TR-RetrievalSource=NewmindAI2026.01 | 67.47 | 56.43 | 38.76 | 59.88 | 51.59 | 64.44 | — | — | — | |
| SimCSE-BERT-supDimension=7682026.06 | 67.32 | — | 33.43 | 74.89 | 26.34 | 79.12 | 47.53 | 31.17 | 53.54 | |
| Mursit-Base-TR-RetrievalSource=NewmindAI2026.01 | 66.25 | 55.86 | 39.75 | 61.31 | 50.07 | 61.9 | — | — | — | |
| KV-EmbeddingBackbone=Llama-3.1-8B-Instruct2026.01 | 66.02 | 52.7 | 44.48 | 73.32 | 30.79 | 73.98 | 52.37 | 27.96 | — | |
| Token PrependingBackbone=Mistral-7B-Instruct-v0.12026.01 | 65.8 | 44.68 | 28.25 | 57.64 | 16.19 | 67.75 | 47.9 | 29.21 | — | |
| Token PrependingBackbone=Llama-3.1-8B-Instruct2026.01 | 65.77 | 46.19 | 33.65 | 57.34 | 18.17 | 69.68 | 49.92 | 28.8 | — | |
| PromptEOLBackbone=Mistral-7B-Instruct-v0.12026.01 | 65.71 | 45.37 | 31.58 | 56.29 | 17.46 | 69.53 | 48.35 | 28.63 | — | |
| tabibert-RetrievalSource=BOUN-TabiLab2026.01 | 65.36 | 52.52 | 36.3 | 60.1 | 47.68 | 53.17 | — | — | — | |
| mmbert-base-RetrievalSource=JHU-CLSP2026.01 | 65.16 | 54.48 | 33.24 | 61.51 | 48.93 | 63.56 | — | — | — | |
| berturk-legal-RetrievalSource=KocLab-Bilkent2026.01 | 64.95 | 53.94 | 39.77 | 58.81 | 48.64 | 57.54 | — | — | — | |
| coCondenser-msmarcoDimension=7682026.06 | 64.71 | — | 37.64 | 81.74 | 35.14 | 76.47 | 51.85 | 29.5 | 55.48 | |
| EchoBackbone=Mistral-7B-Instruct-v0.12026.01 | 63.98 | 50.08 | 36.81 | 75.6 | 24.14 | 73.33 | 47.51 | 29.22 | — | |
| KV-EmbeddingBackbone=Qwen3-4B2026.01 | 63.75 | 49.37 | 39.03 | 68 | 27.65 | 71.41 | 50.07 | 25.66 | — | |
| Token PrependingBackbone=Qwen3-4B2026.01 | 62.83 | 43.2 | 33.72 | 52.06 | 16.22 | 63.7 | 49.01 | 24.83 | — | |
| EchoBackbone=Llama-3.1-8B-Instruct2026.01 | 62.61 | 50.34 | 41.89 | 71.25 | 29.41 | 71.24 | 50.74 | 25.27 | — | |
| PromptEOLBackbone=Llama-3.1-8B-Instruct2026.01 | 62.5 | 47.02 | 40.35 | 59.11 | 20.17 | 69.19 | 49.91 | 27.88 | — | |
| USMoEModel=OLMoE-1B-7B, Evaluation Protocol=PromptEOL2025.03 | 61.4 | — | 32.1 | 68.9 | — | 71.1 | 55.1 | 30.5 | 53.2 | |
| PromptEOLBackbone=Qwen3-4B2026.01 | 61.38 | 44.78 | 36.51 | 56.37 | 18.57 | 67.41 | 49.24 | 23.96 | — | |
| USMoEModel=DeepSeekMoE-16B, Evaluation Protocol=PromptEOL2025.03 | 60.4 | — | 32.8 | 67.9 | — | 68.1 | 52.4 | 30.7 | 52 | |
| w/o KV Re-routingBackbone=Mistral-7B-Instruct-v0.12026.01 | 60.08 | 45.02 | 36.11 | 59.31 | 20.14 | 64.78 | 48.04 | 26.64 | — | |
| USMoEModel=Qwen1.5-MoE-A2.7B, Evaluation Protocol=PromptEOL2025.03 | 59.7 | — | 37.5 | 66.6 | — | 69 | 56.8 | 31 | 53.4 | |
| TCModel=Qwen1.5-MoE-A2.7B, Evaluation Protocol=PromptEOL2025.03 | 58 | — | 34.2 | 60.5 | — | 50.1 | 46.6 | 23 | 45.4 | |
| TCModel=OLMoE-1B-7B, Evaluation Protocol=PromptEOL2025.03 | 57.7 | — | 24.8 | 62 | — | 63.5 | 51.3 | 28.9 | 48 | |
| EchoBackbone=Qwen3-4B2026.01 | 57.61 | 43.75 | 35.3 | 63.67 | 17.27 | 66.34 | 43.15 | 22.94 | — | |
| TCModel=DeepSeekMoE-16B, Evaluation Protocol=PromptEOL2025.03 | 56.4 | — | 29 | 59.8 | — | 49 | 45.7 | 24.4 | 44 | |
| ECModel=OLMoE-1B-7B, Evaluation Protocol=PromptEOL2025.03 | 56.2 | — | 26.9 | 58.9 | — | 44.2 | 51 | 29.7 | 44.5 | |
| w/o KV Re-routingBackbone=Llama-3.1-8B-Instruct2026.01 | 56.11 | 45.13 | 40.76 | 58.39 | 20.88 | 61.87 | 50.44 | 27.46 | — | |
| ECModel=DeepSeekMoE-16B, Evaluation Protocol=PromptEOL2025.03 | 55.4 | — | 20.3 | 53.8 | — | 37.1 | 40.9 | 25.7 | 38.9 | |
| MoEEModel=Qwen1.5-MoE-A2.7B, Evaluation Protocol=PromptEOL2025.03 | 54 | — | 30.1 | 60.3 | — | 64.3 | 51.1 | 27.3 | 47.9 | |
| Last TokenBackbone=Mistral-7B-Instruct-v0.12026.01 | 53.14 | 32.45 | 25.16 | 34.4 | 10.36 | 39.15 | 36.73 | 28.23 | — | |
| MoEEModel=DeepSeekMoE-16B, Evaluation Protocol=PromptEOL2025.03 | 53 | — | 28.5 | 63.3 | — | 63.4 | 50.6 | 29.2 | 48 | |
| MoEEModel=OLMoE-1B-7B, Evaluation Protocol=PromptEOL2025.03 | 51.7 | — | 23.2 | 66 | — | 67.8 | 53.2 | 30.4 | 48.7 | |
| Mean PoolingBackbone=Mistral-7B-Instruct-v0.12026.01 | 51.57 | 37.75 | 34.72 | 56.81 | 8.86 | 48.85 | 37.9 | 25.57 | — | |
| w/o KV Re-routingBackbone=Qwen3-4B2026.01 | 50.94 | 40.96 | 37.69 | 52.96 | 20.23 | 56.31 | 46 | 22.57 | — | |
| RouterModel=Qwen1.5-MoE-A2.7B, Evaluation Protocol=PromptEOL2025.03 | 48.8 | — | 14.3 | 51.9 | — | 48.3 | 41 | 27 | 38.6 | |
| RouterModel=DeepSeekMoE-16B, Evaluation Protocol=PromptEOL2025.03 | 48.6 | — | 17.8 | 57.4 | — | 52.8 | 43.8 | 29.1 | 41.6 | |
| Mean PoolingBackbone=Llama-3.1-8B-Instruct2026.01 | 48.48 | 35.07 | 35.77 | 51.76 | 7.13 | 47.02 | 35.37 | 19.96 | — | |
| Last TokenBackbone=Llama-3.1-8B-Instruct2026.01 | 47.69 | 30.73 | 26.52 | 35.54 | 8.87 | 35.13 | 36.08 | 25.26 | — | |
| Mean PoolingBackbone=Qwen3-4B2026.01 | 46.56 | 33.31 | 33.05 | 52.69 | 2.94 | 45.71 | 32.72 | 19.49 | — | |
| RouterModel=OLMoE-1B-7B, Evaluation Protocol=PromptEOL2025.03 | 43.1 | — | 16.2 | 53.5 | — | 49.4 | 41.7 | 25.6 | 38.3 | |
| Last TokenBackbone=Qwen3-4B2026.01 | 42.43 | 27.21 | 23.95 | 30.54 | 7.22 | 28.18 | 34.76 | 23.41 | — | |
| ECModel=Qwen1.5-MoE-A2.7B, Evaluation Protocol=PromptEOL2025.03 | 35.2 | — | 29.2 | 56 | — | 50 | 45 | 21.9 | 39.6 | |
| bge-en-iclicl=false2025.08 | — | 64.83 | — | — | — | — | — | — | — | |
| bge-en-iclicl=true2025.08 | — | 66.08 | — | — | — | — | — | — | — | |
| bge-large-en-v1.52025.08 | — | 64.23 | — | — | — | — | — | — | — | |
| ECHO2025.08 | — | 64.68 | — | — | — | — | — | — | — | |
| LLM2Vec2025.08 | — | 64.8 | — | — | — | — | — | — | — | |
| MGHicl=false2025.08 | — | 65.87 | — | — | — | — | — | — | — | |
| MGHicl=true2025.08 | — | 66.43 | — | — | — | — | — | — | — | |
| NV-Embed2025.08 | — | 64.18 | — | — | — | — | — | — | — | |
| SGPT2025.08 | — | 58.93 | — | — | — | — | — | — | — | |
| UDEVER-bloom-7b2025.08 | — | 60.63 | — | — | — | — | — | — | — |