bigPatent
Benchmarks
TaskDatasetSOTA resultTrendResults
bigPatent
91.85ROUGE-1
61
BigPatent (test)
62.9ROUGE-1
17
BIGPATENT (test)
76.87ROUGE-1
16
BigPatent
44.94ROUGE-1
9
BigPatent
21.91Perplexity
5
BIGPATENT 1341k samples (test)
53.63ROUGE-1
5
BigPatent 500 samples (human evaluation)
4.27Coherence
4
BIGPATENT
52.29ROUGE-1
1