Multilingual
Benchmarks
TaskDatasetSOTA resultTrendResults
Multilingual low-SNR (evaluation set)
3.2PESQ
23
Multilingual MMMLU MGSM
55.67MMMLU Score
12
Multilingual Indic and English languages (test)
8.44Fertility Score (Assamese)
10
Multilingual
100.4Normalized Score
9
Multilingual (test)
0.785Chinese WER
5
Multilingual
34.15ASR @ 1% FPR
5
Multilingual held-out (test)
0.152Morpheme Error Rate (arp)
5
Multilingual Translation
31.9Score
5
Multilingual Mathematics
57.5Score
5
Multilingual Understanding
72Score
5
Multilingual Exam
59.2Score
5
Multilingual Avg (test)
6.39WER
3
Multilingual zh (test)
3WER
3
Multilingual vi (test)
0.541SIM
3
Multilingual ru (test)
11.84WER
3
Multilingual pt (test)
2.09WER
3
Multilingual it (test)
4.43WER
3
Multilingual id (test)
6.38WER
3
Multilingual fr (test)
9.87WER
3
Multilingual es (test)
4.28WER
3
Multilingual en (test)
1.07WER
3
Multilingual de (test)
0.44WER
3
Multilingual A
98.47Accuracy
1