Scientific Document Summarization on PubMed
0.3102ROUGE-1ScholarSum
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ScholarSumBase LLM=DeepSeek2026.06 | 0.3102 | 0.0928 | 0.2834 | 0.2567 | 0.8531 | |
| ScholarSumBase LLM=Qwen2026.06 | 0.2929 | 0.0735 | 0.2645 | 0.2505 | 0.8435 | |
| QA-promptingBase LLM=Qwen2026.06 | 0.2634 | 0.0748 | 0.241 | 0.2496 | 0.8316 | |
| QA-promptingBase LLM=DeepSeek2026.06 | 0.2585 | 0.0663 | 0.2325 | 0.2187 | 0.8394 | |
| T5Base LLM=None2026.06 | 0.256 | 0.0809 | 0.2345 | 0.1427 | 0.8253 | |
| PEGASUSBase LLM=None2026.06 | 0.2512 | 0.0687 | 0.2172 | 0.1364 | 0.8167 | |
| LEDBase LLM=None2026.06 | 0.2447 | 0.0739 | 0.2211 | 0.21 | 0.7808 | |
| Naive RAGBase LLM=DeepSeek2026.06 | 0.2394 | 0.0485 | 0.2135 | 0.179 | 0.7938 | |
| Naive RAGBase LLM=Qwen2026.06 | 0.2382 | 0.0511 | 0.2114 | 0.2029 | 0.7931 | |
| SumCotBase LLM=Qwen2026.06 | 0.206 | 0.0412 | 0.1851 | 0.2312 | 0.8191 | |
| SumCotBase LLM=DeepSeek2026.06 | 0.1934 | 0.0299 | 0.1801 | 0.1818 | 0.8141 |