Gigaword
Benchmarks
TaskDatasetSOTA resultTrendResults
Gigaword (test)
46.99ROUGE-1
75
Gigaword (test)
39.81ROUGE-1
58
Gigaword (test)
20.7ROUGE-2
38
Gigaword
36.88ROUGE-L
38
Annotated English Gigaword (test)
39.61ROUGE-1
15
Gigaword
39.65ROUGE-1
14
Gigaword full-length F1 (test)
37.04ROUGE-1 F1
12
Gigaword HuggingFace
35.3ROUGE-1
8
Gigaword non-anonymized (test)
38.45ROUGE-1
7
Gigaword 3.8M
39.25ROUGE-1
7
Gigaword
29.14ROUGE-1 F1
6
Gigaword 10k samples
35.51ROUGE-1
6
Gigaword sampled 200 instances (test)
2.846Informativeness
6
Gigaword 100 randomly-selected articles (test)
3.55Informativity
6
Gigaword two length limit
36.54ROUGE-1 F-Score
6
Gigaword (test)
39.63ROUGE-1
5
Gigaword (evaluation)
40.4ROUGE-1
5
Gigaword 3995k samples (test)
39.14ROUGE-1
5
Gigaword (dev)
16.4Perplexity
5
Internal English Gigaword (test)
46.86ROUGE-1
5
Gigaword (internal test)
36.4ROUGE-1
5
Gigaword
47Rank 1 Proportion
4
GigaWord v5 (test)
38.3Perplexity
2