Text Embedding on MTEB Turkish (test)
65.42Overall MTEB Scoreembeddinggemma-300m
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| embeddinggemma-300mParams=307M, Type=Emb.2026.01 | 65.42 | 50.63 | 77.74 | 45.05 | 80.02 | 55.06 | 69.22 | 83.97 | 39.56 | 28.38 | |
| bge-m3Params=567M, Type=Emb.2026.01 | 62.87 | 51.16 | 75.35 | 35.86 | 78.88 | 54.42 | 69.83 | 86.08 | 38.09 | 29.3 | |
| Mursit-Embed-Qwen3-1.7B-TRParams=1.7B, Type=CLM-E.2026.01 | 56.84 | 34.76 | 68.46 | 42.22 | 59.67 | 50.1 | 63.77 | 70.22 | 17.94 | 16.11 | |
| Mursit-Large-TR-RetrievalParams=403M, Type=Emb.2026.01 | 56.43 | 46.42 | 67.47 | 38.76 | 59.88 | 51.59 | 64.44 | 81.63 | 32.39 | 25.24 | |
| Mursit-Large-TR-RetrievalModel Category=Post-trained, Model Size=Large2026.01 | 56.43 | — | — | — | — | — | — | — | — | — | |
| Mursit-Base-TR-RetrievalParams=155M, Type=Emb.2026.01 | 55.86 | 47.52 | 66.25 | 39.75 | 61.31 | 50.07 | 61.9 | 80.4 | 34.1 | 28.07 | |
| Mursit-Base-TR-RetrievalModel Category=Post-trained, Model Size=Base2026.01 | 55.86 | — | — | — | — | — | — | — | — | — | |
| Mursit-Embed-Qwen3-4B-TRParams=4B, Type=CLM-E.2026.01 | 53.65 | 37 | 67.29 | 36.68 | 58.36 | 51.12 | 54.77 | 69.25 | 24.21 | 17.56 | |
| bert-base-turkish-uncasedParams=110M, Type=MLM2026.01 | 46.23 | 24.94 | 68.05 | 33.81 | 60.44 | 32.01 | 36.85 | 52.47 | 12.05 | 10.29 | |
| turkish-large-bert-casedParams=337M, Type=MLM2026.01 | 45.3 | 19.12 | 67.43 | 34.24 | 60.11 | 28.68 | 36.04 | 47.57 | 5.93 | 3.85 | |
| bert-base-turkish-casedParams=110M, Type=MLM2026.01 | 45.17 | 24.41 | 66.39 | 35.28 | 60.05 | 30.52 | 33.62 | 54.03 | 10.13 | 9.07 | |
| turkish-base-bert-uncasedParams=110M, Type=MLM2026.01 | 44.68 | 27.58 | 66.22 | 30.23 | 58.84 | 31.4 | 36.74 | 56.6 | 13.39 | 12.74 | |
| BERTurk-LegalParams=184M, Type=MLM2026.01 | 42.02 | 32.63 | 60.61 | 26.24 | 59.51 | 25.8 | 37.94 | 61.4 | 15.51 | 20.99 | |
| Mursit-LargeParams=403M, Type=MLM2026.01 | 41.75 | 23.71 | 62.95 | 25.34 | 58.04 | 27.4 | 35.01 | 42.74 | 11.29 | 17.1 | |
| Mursit-LargeModel Category=Pretrained, Model Size=Large2026.01 | 41.75 | — | — | — | — | — | — | — | — | — | |
| Mursit-BaseParams=155M, Type=MLM2026.01 | 40.23 | 17.93 | 59.78 | 25.48 | 58.65 | 20.82 | 36.45 | 36 | 7.4 | 10.4 | |
| Mursit-BaseModel Category=Pretrained, Model Size=Base2026.01 | 40.23 | — | — | — | — | — | — | — | — | — | |
| mmBERT-baseParams=306M, Type=MLM2026.01 | 39.65 | 12.15 | 61.84 | 26.77 | 59.25 | 15.83 | 34.56 | 34.45 | 1.33 | 0.68 | |
| TabiBERTParams=148M, Type=MLM2026.01 | 37.77 | 11.5 | 59.63 | 25.75 | 58.19 | 14.96 | 30.32 | 32.02 | 1.86 | 0.63 | |
| ModernBERT-baseParams=149M, Type=MLM2026.01 | 23.8 | 2.99 | 39.06 | 2.01 | 53.95 | 2.1 | 21.91 | 7.92 | 0.62 | 0.43 | |
| ModernBERT-baseModel Category=Original ModernBERT, Model Size=Base2026.01 | 23.8 | — | — | — | — | — | — | — | — | — | |
| ModernBERT-largeParams=394M, Type=MLM2026.01 | 23.74 | 2.44 | 39.44 | 3.9 | 53.73 | 1.8 | 19.85 | 6.12 | 0.62 | 0.59 | |
| ModernBERT-largeModel Category=Original ModernBERT, Model Size=Large2026.01 | 23.74 | — | — | — | — | — | — | — | — | — |