ArXiv
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
arXiv
41.2Macro F1 Score
4
ArXiv
73ROUGE-1
3
arxiv
5.43PPL
3
arXiv (test)
27.34Macro F1
3
Arxiv
92.31F1 Micro
3
Arxiv (test)
0.3Error Rate (%)
3
ArXiv Paper
82.7Top-1 Accuracy
2
arXiv corpus
86.9Trustworthiness
2
Arxiv Low Consistency (score_cons < 0.73)
58.6Coverage
2
Arxiv Low Coverage (score_cov < 0.60)
60.4Coverage
2
Arxiv All Summaries
58.6Coverage
2
arXiv
69.55Build Time (s)
2
arXiv 495 sentences
0.667R@1
2
Arxiv Mistral-7B
0.571KGW-WM IoU
2
Arxiv Llama-7B
71.8KGW-WM IoU
2
arXiv (train)
3.9Training Throughput
2