Semantic Textual Similarity on MTEB (test)
64.65Average STS ScoreLaBSE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LaBSE2024.09 | 64.65 | 70.93 | 47.5 | 74.33 | 65.82 | — | — | — | |
| MEXMA2024.09 | 63.99 | 70.62 | 51.56 | 70.1 | 63.67 | — | — | — | |
| DAP2024.09 | 59.39 | 67.45 | 45.31 | 67.74 | 57.06 | — | — | — | |
| SONAR2024.09 | 58.04 | 67.24 | 42.15 | 65.6 | 57.17 | — | — | — | |
| MetaEOLDim=4096, Backbone=Llama-22026.02 | — | — | — | — | — | 82.29 | 76.88 | 76.87 | |
| VADim=4096, Backbone=Llama-2, Aggregation Strategy=Layer Selection2026.02 | — | — | — | — | — | 75.37 | 61.92 | 63.03 | |
| VADim=1024, Backbone=Qwen-3, Aggregation Strategy=Layer Selection2026.02 | — | — | — | — | — | 76.28 | 62.98 | 63.24 | |
| WMPDim=4096, Backbone=Llama-22026.02 | — | — | — | — | — | 63.91 | 57.52 | 58.01 |