MuST-C
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MuST-C
0.999Pearson Correlation
94
MuST-C EN-DE (test-COMMON)
31.7BLEU
41
MuST-C EN-DE (tst-COMMON)
23.8BLEU
39
MuST-C en-de v1.0 (test)
27.38BLEU
36
MuST-C en-ru v1.0 (test)
18.5BLEU
36
MuST-C en-ro 1.0 (test)
26.44BLEU
36
MuST-C en-pt v1.0 (test)
32.23BLEU
36
MuST-C en-nl 1.0 (test)
31.41BLEU
36
Must-C (test)
1.37Cosine Similarity
36
MuST-C (test)
6.54WER (Avg)
30
MuST-C (test)
31.54BLEU Score
29
MuST-C (test)
76.11EM
27
MuST-C
0.831LASER
21
MuST-C (tst-COMMON)
31.2BLEU (De)
20
MuST-C En-De (test)
28.7SacreBLEU
18
MuST-C EN-FR COMMON (test)
37.4BLEU
17
MuST-C En-X (tst-COM)
30.1BLEU (German)
16
MuST-C En-De COMMON (test)
6.54WER
16
Must-C
31.54BLEU
15
MuST-C En-De (tst-HE)
22.3BLEU
14
MuST-C en-de (dev)
26.92BLEU
14
MuST-C EN-ES (tst-COMMON)
31BLEU
14
MuST-C en-es v1.0 (test)
35.14BLEU
13
MuST-C en-de v1.0 (test)
27.32BLEU
13
MuST-C COMMON (tst)
16.5WER (de)
13