Belebele
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Belebele Indonesian 1.0 (test)
91Accuracy
11
Belebele Arabic 1.0 (test)
91Belebele Score
11
Belebele Russian (test)
92Accuracy
11
Belebele French (test)
92Accuracy
11
Belebele Japanese (test)
87Accuracy
11
Belebele Chinese (test)
92Belebele Accuracy
11
Belebele Portuguese (test)
91Accuracy
11
Belebele Vietnamese (test)
91Belebele Score
11
BELEBELE German
92Accuracy
11
Belebele
65.9Reading Comprehension Score (Xho)
10
Belebele
86.81Accuracy
10
BELEBELE Yoruba
31.9Accuracy (Target)
10
BELEBELE Swahili
42.6Accuracy (Target)
10
BELEBELE Korean
68.8Accuracy (Target)
10
BELEBELE Chinese
0.834Accuracy (Target)
10
Belebele
71.43Accuracy
9
BELEBELE
83.44Accuracy (Hindi)
9
Belebele Kazakh (test)
31.7Accuracy
9
Belebele Non-English
76.84Accuracy
9
Belebele Basque
94.22Accuracy
8
Belebele EL
0.673Accuracy
8
Belebele ET
52.9Accuracy
8
Belebele_c Spanish
35.33Accuracy (Normalized)
7
Belebele pl (test)
64.89Accuracy
6
Belebele de
71.78Accuracy
6