List your company
ResearchFormerly WizWand

Document Summarization on QMSum

15.47G-meanE2LLM
3.1466.34559.54512.7445Sep 10, 2024
Updated 6mo ago

Evaluation results

MethodLinks
E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.0915.4713.66
LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.0912.9946.32
YaRNTrainable Parameters=17M, Context Window=64K, Extension Method=Len. Exten.2024.0912.3116.22
RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.0912.1717.21
Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.0911.5184.92
CEPETrainable Parameters=1.31B, Context Window=128k, Extension Method=Len. Exten.2024.0910.77154.16
LongLoRATrainable Parameters=140M, Context Window=100K, Extension Method=Sparse Attn.2024.098.9814.48
LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.098.9317.55
StreamingLLMTrainable Parameters=0M, Context Window=4M, Extension Method=Sparse Attn.2024.093.62220.12