WIT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WIT translated English (test)
0.308Recall@1
13
WIT translated English (test)
29.98Recall@1
13
WIT Under-resourced v1 (test)
0.729Recall@1 (tg)
8
WIT Well-resourced v1 (test)
82.4Retrieval Score (en)
8
WIT reversed input/output mapping (transductive)
30Win Rate
6
WIT standard (transductive)
32Win-rate
6
WIT rev. (inductive)
30Win Rate
6
WIT (inductive)
32Win Rate
6
WIT EN-AF (test)
14BLEU
5
WIT EN-RO (test)
14.4BLEU
5
WIT ES-FR (test)
16.6BLEU Score
5
WIT (DE-ES) (test)
11.3BLEU
5
WIT EN-FR (test)
18.8BLEU
5
WIT EN-ES (test)
27.5BLEU
5
WIT EN-DE (test)
17.5BLEU
5
WIT
36.8EN->DE Score
5