IWSLT
Benchmarks
TaskDatasetSOTA resultTrendResults
IWSLT 2017 (test)
37.21BLEU
14
IWSLT de-en (test)
37.95BLEU
13
IWSLT Metrics Shared Task 2026 (dev)
32.7Kendall's Tau (en-de)
12
IWSLT Bemba-English KIT 2025 (test)
0.715Metric Mu
12
IWSLT Bemba-English (JHU@iwslt25) 2025 (test)
13.582Mean Score (mu)
12
IWSLT Bemba-English (Prototype) 2025 (test)
0.695Mean Error (mu)
12
IWSLT DE→EN 14
33.61SacreBLEU
12
IWSLT en-ja 17
41.22ROUGE-L
12
IWSLT14 (test)
32.2SacreBLEU
12
IWSLT DE-EN '14 (train)
3Training Perplexity
12
IWSLT'14 DE-EN (val)
4.13Validation PPL
12
IWSLT German-English 2014 (tst2010-2012)
36.22BLEU
11
IWSLT En-Fr 2017 (test)
40.02BLEU
11
IWSLT14 en-fr (test)
40.9BLEU
10
IWSLT14 fr-en (test)
40.3BLEU
10
IWSLT Thai-English 2012/2013 2015 (test)
15.6BLEU (n=1)
10
IWSLT Turkish-English (tst2014)
24.54BLEU
10
IWSLT Turkish-English (tst2013)
24.92BLEU
10
IWSLT Turkish-English 2012 (test)
24.65BLEU
10
IWSLT Turkish-English (tst2011)
23.33BLEU
10
IWSLT Metrics Shared Task 2026 (test)
95.1Soft Pairwise Accuracy (en-de)
9
IWSLT Metrics Shared Task 2026 (test)
26.7Kendall's Tau (en-de)
9
IWSLT English (test)
84F1 (Comma)
9
IWSLT DE-EN 2014 (dev)
35.66BLEU
9
IWSLT En-Fr 2016 (test)
40.91BLEU
9