MTEB
Benchmarks
TaskDatasetSOTA resultTrendResults
MTEB English v2
74.6Mean Score
113
MTEB
90.4Classification Score
82
MTEB (test)
90.37Classification Score
55
MTEB Multilingual v2
70.9nDCG@10
40
MTEB (test)
72.97Average Score
38
MTEB Multilingual
72.3Mean Score (Task)
33
MTEB eng v2
69.4nDCG@10
31
MTEB Code v1
70Average Performance
30
MTEB v2
45.9NDCG@10
28
MTEB eng v2 (test)
67.95Average Score
26
MTEB Code Retrieval Average (val)
74nDCG@5
24
MTEB Turkish (test)
65.42Overall MTEB Score
23
MTEB Clustering
33.13Bior Score
23
MTEB Code
80.07nDCG@10
21
MTEB 8-task suite
65.61Average Reranking Score
20
MTEB eng v2
70.2Ask Score
20
MTEB multilingual v2
85.13Allo Score
20
MTEB English 2023 (test)
89.37BIO
19
MTEB Clustering v1 (test)
58.14TNG
18
MTEB v2
42.5Clustering Score
17
MTEB Multilingual V2 (test)
62.5Mean Score (TaskType)
16
MTEB Corrupt
40Classification Score
15
MTEB Clean
51.6Classification Score
15
MTEB [hye]
78.04Score
13
MTEB classification (test)
67Emotion Score
12