Document Summarization on QMSum
15.47G-meanE2LLM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.09 | 15.47 | 13.66 | |
| LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.09 | 12.99 | 46.32 | |
| YaRNTrainable Parameters=17M, Context Window=64K, Extension Method=Len. Exten.2024.09 | 12.31 | 16.22 | |
| RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.09 | 12.17 | 17.21 | |
| Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.09 | 11.51 | 84.92 | |
| CEPETrainable Parameters=1.31B, Context Window=128k, Extension Method=Len. Exten.2024.09 | 10.77 | 154.16 | |
| LongLoRATrainable Parameters=140M, Context Window=100K, Extension Method=Sparse Attn.2024.09 | 8.98 | 14.48 | |
| LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.09 | 8.93 | 17.55 | |
| StreamingLLMTrainable Parameters=0M, Context Window=4M, Extension Method=Sparse Attn.2024.09 | 3.62 | 220.12 |