WikiLingua
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Wikilingua Vi-En Seen Languages GEM
33.29ROUGE-1
10
Wikilingua Tr-En Seen Languages GEM
37.66ROUGE-1
10
Wikilingua Ru-En Seen Languages GEM
33.56ROUGE-1
10
Wikilingua Es-En Seen Languages GEM
38.3ROUGE-1
10
GEM WikiLingua vi -> en
19.1ROUGE-2
9
GEM WikiLingua es -> en
20.9ROUGE-2
9
WikiLingua
3.52IF
9
WikiLingua tr -> en GEM (test)
23.1ROUGE-2
9
WikiLingua (test)
60.22ROUGE-1
9
Wikilingua Hi-En
34.16ROUGE-1
9
Wikilingua Id-En
35.15ROUGE-1
9
Wikilingua Fr-En
36.28ROUGE-1
9
WikiLingua GEM en -> en (test)
23.8ROUGE-2 Score
8
WikiLingua (test)
30.81Score (De)
7
WikiLingua (test)
0.84BertScore (EN)
6
WikiLingua target languages
24.9AR Score
6
WikiLingua GEM (test)
10.4ROUGE-2
5
WikiLingua
18.6ROUGE-2 (ru->en)
4
WikiLingua (test)
23.5ROUGE-2
4
WikiLingua High-Resource Directions
32.4RS (En->En)
3
WikiLingua Low-Resource Directions
26.5Fr->Th (RS) Score
3
WikiLingua Conventional Zero-Shot Directions
21.4RS Score (Fr->Hi)
3
WikiLingua Non-Trivial Zero-Shot Directions
20.2RS Score (Tr->En)
3
WikiLingua vi -> en GEM (test)
—ROUGE-2
0
WikiLingua ru -> en GEM (test)
—ROUGE-2
0