MM-Sum
Benchmarks
TaskDatasetSOTA resultTrendResults
MM-Sum Zero-Resource Languages (test)
33.67ROUGE-1 Score
96
MM-Sum low-resource 1.0
47.96ROUGE-1
96
MM-Sum mid-high-resource
41.51ROUGE-1
90
MM-Sum mid-high-resource (test)
41.59ROUGE-1
90
MM-Sum Avg., low-resource
30.55ROUGE-1 Score
6
MM-Sum Welsh low-resource
32.86ROUGE-1
6
MM-Sum Telugu, low-resource
19.87ROUGE-1 Score
6
MM-Sum Swahili low-resource
38.02ROUGE-1
6
MM-Sum Serbian Latin, low-resource
21.89ROUGE-1
6
MM-Sum Serbian Cyrillic, low-resource
23.88R-1
6
MM-Sum Punjabi, low-resource
30.57ROUGE-1
6
MM-Sum Pidgin low-resource
37.91R-1
6
MM-Sum Pashto low-resource
38.15ROUGE-1
6
MM-Sum Oromo low-resource
18.82ROUGE-1
6
MM-Sum Marathi low-resource
22.61ROUGE-1
6
MM-Sum Japanese low-resource
47.79ROUGE-1 Score
6
MM-Sum Hausa low-resource
39.28ROUGE-1
6
MM-Sum Gujarati, low-resource
22.18ROUGE-1
6
MM-Sum French, low-resource
35.93ROUGE-1
6
MM-Sum Bengali low-resource
28.58ROUGE-1
6
MM-Sum Zero-Resource Languages 1.0 (test)
—ROUGE-1
0
MM-Sum mid-high-resource 1.0
—ROUGE-1
0