GovReport
Benchmarks
TaskDatasetSOTA resultTrendResults
GovReport
2.5Perplexity
50
GovReport (test)
75.56ROUGE-1
50
GovReport
3.36Speedup (×)
32
GovReport
3.09Speedup
31
GovReport
46ROUGE Score
30
GovReport (val)
47.2ROUGE-L
17
GovReport
60.64ROUGE-1
15
GovReport
89ASR Score
14
GovReport
17.4Token MAE
14
GovReport
61.39ROUGE-1
13
GovReport (test)
0.555ROUGE-1
13
GovReport 16K
11895th Percentile Latency (ms)
12
GovReport
22.03ROUGE-1 Score
12
GovReport
0Attack Success Rate (ASR)
11
GovReport (test)
16.11ROUGE-1
10
GovReport
46.93ROUGE-1
9
GovReport
18.43G-mean
9
GovReport
68.4C Score
9
GovReport
82.8Citation Recall
9
GovReport
0.92BERTScore
7
GovReport (GR)
75.3Accuracy
5
GovReport 500 samples (human evaluation)
4.27Coherence
4
GovReport
100ASR
4
GovReport (test)
61Relevance
4
GovReport SCROLLS (test)
48.18ROUGE-1
3