Question Answering on NarrativeQA (F1, PPL)
12.47F1 ScoreE2LLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.09 | 12.47 | 13.07 | |
| LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.09 | 10.87 | 16.88 | |
| RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.09 | 5.03 | 48.42 | |
| Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.09 | 4.65 | 2,111.23 | |
| LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.09 | 4.53 | 31.36 |