Question Answering on TriviaQA (F1, PPL)
63.21F1 ScoreLLoCO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.09 | 63.21 | 10.8 | |
| E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.09 | 38.57 | 7.53 | |
| YaRNTrainable Parameters=17M, Context Window=64K, Extension Method=Len. Exten.2024.09 | 20.22 | 106.43 | |
| LongLoRATrainable Parameters=140M, Context Window=100K, Extension Method=Sparse Attn.2024.09 | 19.69 | 438.25 | |
| StreamingLLMTrainable Parameters=0M, Context Window=4M, Extension Method=Sparse Attn.2024.09 | 14.53 | 596.87 | |
| LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.09 | 14.01 | 76.06 | |
| Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.09 | 12.06 | 1,956.51 | |
| RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.09 | 11.15 | 98.96 |