Long-Context Summarization on GovReport
22.03ROUGE-1 ScoreSAC
Evaluation results
| Method | Links | |
|---|---|---|
| SACMaximum input length=32K2025.10 | 22.03 | |
| EPLMaximum input length=32K2025.10 | 20.4 | |
| FlashMemBackbone=Llama 3.1 8B Instruct2026.01 | 17.23 | |
| MemGenBackbone=Llama 3.1 8B Instruct2026.01 | 16.37 | |
| CoT-SCBackbone=Llama 3.1 8B Instruct2026.01 | 15.41 | |
| FlashMemBackbone=Llama 3.2 3B Instruct2026.01 | 14.55 | |
| SnapKVBackbone=Llama 3.2 3B Instruct2026.01 | 14.43 | |
| VanillaBackbone=Llama 3.1 8B Instruct2026.01 | 13.95 | |
| CoT-SCBackbone=Llama 3.2 3B Instruct2026.01 | 13.61 | |
| MemGenBackbone=Llama 3.2 3B Instruct2026.01 | 13.44 | |
| VanillaBackbone=Llama 3.2 3B Instruct2026.01 | 12.92 | |
| SnapKVBackbone=Llama 3.1 8B Instruct2026.01 | 12.81 |