List your company
ResearchFormerly WizWand

Document Summarization on GovReport (G-mean and PPL)

18.43G-meanE2LLM
3.95327.711611.4715.2284Sep 10, 2024
Updated 6mo ago

Evaluation results

MethodLinks
E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.0918.432.81
LongLoRATrainable Parameters=140M, Context Window=100K, Extension Method=Sparse Attn.2024.0916.352.88
RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.0914.455.88
YaRNTrainable Parameters=17M, Context Window=64K, Extension Method=Len. Exten.2024.096.722.94
LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.095.736.42
Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.095.59.04
CEPETrainable Parameters=1.31B, Context Window=128k, Extension Method=Len. Exten.2024.094.8252.32
LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.094.5623.53
StreamingLLMTrainable Parameters=0M, Context Window=4M, Extension Method=Sparse Attn.2024.094.51330.54