Tatoeba
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Tatoeba it->en
79.041sacreBLEU
33
Tatoeba en->it
63.261sacreBLEU
33
Tatoeba
50.3Performance (es)
27
Tatoeba Parallel 14 language pairs
80.6Accuracy
14
Tatoeba (full)
85.4Accuracy
12
Tatoeba-36
69Average Accuracy@1
11
Tatoeba-36
76.4Accuracy@1
11
Tatoeba
5.82MAE
9
Tatoeba
6.16MAE
9
Tatoeba (test)
30.2SacreBLEU Score (Da)
8
Tatoeba (test)
35.7BLEU
7
Tatoeba
54.4ChrF++
7
Tatoeba 4392 utterances
30.7SacreBLEU (Fr)
6
Tatoeba (test)
21.1BLEU Score
6
Tatoeba
48.6ChrF++
6
Tatoeba (test)
55.2af
6
Tatoeba (test)
21.8BLEU
5
Tatoeba (test)
39.4BLEU
5
Tatoeba (test)
41.3BLEU
5
Tatoeba
40.1ChrF++
5
Tatoeba
57.3ChrF++
5
Tatoeba
62.4ChrF++
5
Tatoeba
93.3Accuracy
4
Tatoeba (test)
13.8BLEU
4
Tatoeba (test)
29.9BLEU
4