List your company

ResearchFormerly WizWand

Tatoeba

Benchmarks

TaskDatasetSOTA resultTrendResults

Machine Translation

Tatoeba it->en

79.041sacreBLEU

33

Machine Translation

Tatoeba en->it

63.261sacreBLEU

33

Language Steering

Tatoeba

50.3Performance (es)

27

Cross-lingual sentence retrieval

Tatoeba Parallel 14 language pairs

80.6Accuracy

14

Tatoeba (full)

85.4Accuracy

12

Cross-lingual sentence retrieval (xx → en)

Tatoeba-36

69Average Accuracy@1

11

Cross-lingual sentence retrieval (en → xx)

Tatoeba-36

76.4Accuracy@1

11

Performance Prediction

Tatoeba

5.82MAE

9

Zero-shot performance prediction

Tatoeba

6.16MAE

9

Machine Translation

Tatoeba (test)

30.2SacreBLEU Score (Da)

8

Machine Translation (tr→en)

Tatoeba (test)

35.7BLEU

7

Machine Translation (tr->en)

Tatoeba

54.4ChrF++

7

Speech-to-Text Translation

Tatoeba 4392 utterances

30.7SacreBLEU (Fr)

6

Machine Translation (en→tr)

Tatoeba (test)

21.1BLEU Score

6

Machine Translation (en->tr)

Tatoeba

48.6ChrF++

6

Cross-lingual sentence retrieval

Tatoeba (test)

55.2af

6

Machine Translation (ko→en)

Tatoeba (test)

21.8BLEU

5

Machine Translation (ru→en)

Tatoeba (test)

39.4BLEU

5

Machine Translation (pt→en)

Tatoeba (test)

41.3BLEU

5

Machine Translation (ko->en)

Tatoeba

40.1ChrF++

5

Machine Translation (ru->en)

Tatoeba

57.3ChrF++

5

Machine Translation (pt->en)

Tatoeba

62.4ChrF++

5

Cross-lingual Sentence Retrieval

Tatoeba

93.3Accuracy

4

Machine Translation (en→ko)

Tatoeba (test)

13.8BLEU

4

Machine Translation (en→ru)

Tatoeba (test)

29.9BLEU

4