MTEB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MTEB
72.32Average (Multi-Language/Domain) Performance
12
MTEB Code (test)
98.1Apps Score
12
MTEB Clustering standard (test)
63.48AskU. Score
12
MTEB-ZH 8 subsets (test)
0.72nDCG@10
11
MTEB-FR 5 subsets (test)
57.6nDCG@10
11
MTEB Reranking (test)
54.56MAP (AU)
11
MTEB eng v1 (various)
67.6Classification Score
10
MTEB English BEIR Retrieval
38.46Average Score
10
MTEB English STS subsets
75.88Average STS Score
10
MTEB English Summarization
32.17Main Score
10
MTEB English Clustering
45.8Average Score
10
MTEB English Classification subsets
65.12Average Classification Score
10
MTEB (test)
0.677MRR (Avg Med)
9
MTEB (Massive Text Embedding Benchmark)
68.74Average Score (Multi)
8
MTEB
67.8MTEB Quality Score
8
MTEB 8 representative tasks including Banking77, SprintDuplicateQuestions, TwitterSemEval, ArguAna (test)
0.752Classification Acc
8
MTEB Retrieval (BEIR) 1.0 (test)
46.5MSMARCO
8
MTEB v2 (test)
70.1Classification Score
7
MTEB v2
0.39NDCG@10
7
MTEB ChemTEB
78.1nDCG@10
6
MTEB Law
60.8nDCG@10
6
MTEB Medical
67.7nDCG@10
6
MTEB Code
64.3nDCG@10
6
MTEB Multilingual
62.3nDCG@10
6
MTEB English
59.3nDCG@10
6