Code Retrieval on MTEB Code
80.07nDCG@10qwen3-embed-4B
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| qwen3-embed-4BDocs/MB=97, Number of Parameters=4B2026.02 | 80.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| pplx-embed-v1-4BDocs/MB=390, Precision=INT8, Number of Parameters=4B2026.02 | 78.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| pplx-embed-v1-4BDocs/MB=3,125, Precision=BIN, Number of Parameters=4B2026.02 | 78.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| gemini-embedding-001Docs/MB=81, Number of Parameters=unknown2026.02 | 76 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| pplx-embed-v1-0.6BDocs/MB=976, Precision=INT8, Number of Parameters=0.6B2026.02 | 75.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| qwen3-embed-0.6BDocs/MB=244, Number of Parameters=0.6B2026.02 | 75.42 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| pplx-embed-v1-0.6BDocs/MB=7,812, Precision=BIN, Number of Parameters=0.6B2026.02 | 73.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| jina-embeddings-v5-text-nanoParams (M)=239, Embed. Size=768, MSL=81922026.05 | 71.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| embeddinggemma-300mParams (M)=300, Embed. Size=768, MSL=81922026.05 | 69 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| embed-gemma-0.3BDocs/MB=325, Number of Parameters=0.3B2026.02 | 68.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| f2llm-v2-80mParams (M)=80, Embed. Size=320, MSL=81922026.05 | 68 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| text-embedding-3-largeDocs/MB=81, Number of Parameters=unknown2026.02 | 66.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| granite-embedding-311m-multilingual-r2Params (M)=311, Embed. Size=768, MSL=81922026.05 | 63.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| harrier-oss-v1-270mParams (M)=270, Embed. Size=640, MSL=81922026.05 | 62.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| granite-embedding-97m-multilingual-r2Params (M)=97, Embed. Size=384, MSL=81922026.05 | 60.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| gte-multilingual-baseParams (M)=305, Embed. Size=768, MSL=81922026.05 | 57.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| snowflake-arctic-embed-m-v2.0Params (M)=305, Embed. Size=768, MSL=81922026.05 | 55.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| multilingual-e5-baseParams (M)=278, Embed. Size=768, MSL=81922026.05 | 52.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| multilingual-e5-smallParams (M)=96, Embed. Size=384, MSL=81922026.05 | 51.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| granite-embedding-278m-multilingualParams (M)=278, Embed. Size=768, MSL=81922026.05 | 48.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| granite-embedding-107m-multilingualParams (M)=107, Embed. Size=384, MSL=81922026.05 | 47.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| C2LLMSize=7B2025.12 | — | 86.71 | 91.07 | 97.9 | 89.79 | 81.49 | 94.32 | 90.66 | 92.51 | 34.13 | 39.76 | 94.85 | 75.75 | 80.75 | |
| C2LLMSize=0.5B2025.12 | — | 61.02 | 89.2 | 96.29 | 86.71 | 71.39 | 92.29 | 88.63 | 84.27 | 33.99 | 38.3 | 89.4 | 74.08 | 75.46 | |
| EmbedGemmaSize=0.3B2025.12 | — | 84.39 | 90.15 | 73.71 | 75.54 | 62.1 | 51.42 | 80.26 | 85.51 | 33.52 | 43.6 | 86.47 | 58.42 | 68.76 | |
| Gemini-EmbedSize=NA2025.12 | — | 93.75 | 91.33 | 84.69 | 81.06 | 81.61 | 56.28 | 85.33 | 89.53 | 31.47 | 50.24 | 96.71 | 69.96 | 76 | |
| INF-RetrieverSize=7B2025.12 | — | 47.37 | 88.77 | 75.71 | 72.27 | 71.79 | 77.64 | 86.63 | 89.16 | 35.18 | 34.18 | 94.22 | 63.51 | 69.7 | |
| INF-RetrieverSize=1.5B2025.12 | — | 38.9 | 90.87 | 75.5 | 78.63 | 67.17 | 77.47 | 84.51 | 85.01 | 33.84 | 33.11 | 91.32 | 65.59 | 68.49 | |
| Qwen3-EmbedSize=8B2025.12 | — | 91.07 | 92.66 | 96.35 | 89.51 | 76.97 | 93.7 | 89.93 | 93.73 | 32.81 | 38.04 | 94.75 | 78.75 | 80.69 | |
| Qwen3-EmbedSize=4B2025.12 | — | 89.18 | 92.34 | 95.59 | 87.93 | 76.49 | 93.21 | 89.51 | 90.99 | 35.04 | 37.98 | 94.32 | 78.21 | 80.07 | |
| Qwen3-EmbedSize=0.6B2025.12 | — | 75.34 | 91.01 | 91.72 | 84.69 | 64.42 | 90.82 | 86.39 | 86.05 | 31.36 | 36.48 | 89.99 | 76.74 | 75.42 | |
| Seed1.6-EmbedSize=NA2025.12 | — | 91.15 | 93.17 | 94.15 | 89.5 | 92.14 | 90.11 | 90.44 | 90.16 | 35.99 | 41.17 | 97.2 | 63.31 | 80.71 |