Scientific Document Summarization on ArXiv (R-1, R-2, R-L, METEOR, BERTScore)
27.64ROUGE-1ScholarSum
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ScholarSumBase LLM=Qwen2026.06 | 27.64 | 6.46 | 24.12 | 25.41 | 83.38 | |
| ScholarSumBase LLM=DeepSeek2026.06 | 26.92 | 7.08 | 23.62 | 23 | 83.6 | |
| T5Base LLM=None2026.06 | 26.38 | 6.7 | 23.23 | 15.87 | 82.73 | |
| QA-promptingBase LLM=DeepSeek2026.06 | 26.35 | 6.94 | 23.12 | 23.62 | 82.94 | |
| PEGASUSBase LLM=None2026.06 | 25.5 | 6.26 | 20.34 | 15.97 | 81.31 | |
| QA-promptingBase LLM=Qwen2026.06 | 23.39 | 6.52 | 20.97 | 25.39 | 81.54 | |
| Naive RAGBase LLM=DeepSeek2026.06 | 22.97 | 3.77 | 19.18 | 17.59 | 78.29 | |
| LEDBase LLM=None2026.06 | 22.67 | 6.05 | 20 | 19.72 | 77.39 | |
| Naive RAGBase LLM=Qwen2026.06 | 20.85 | 3.3 | 18.05 | 18.32 | 77.74 | |
| SumCotBase LLM=DeepSeek2026.06 | 20.27 | 4.09 | 18.37 | 22.3 | 81.28 | |
| SumCotBase LLM=Qwen2026.06 | 19.4 | 3.9 | 17.3 | 24.56 | 81.33 |