List your company
ResearchFormerly WizWand

Question Answering on TriviaQA (F1, PPL)

63.21F1 ScoreLLoCO
9.067623.123837.1851.2362Sep 10, 2024
Updated 6mo ago

Evaluation results

MethodLinks
LLoCOTrainable Parameters=17M, Context Window=128K, Extension Method=Soft Comp.2024.0963.2110.8
E2LLMTrainable Parameters=11M, Context Window=400K, Extension Method=Soft Comp.2024.0938.577.53
YaRNTrainable Parameters=17M, Context Window=64K, Extension Method=Len. Exten.2024.0920.22106.43
LongLoRATrainable Parameters=140M, Context Window=100K, Extension Method=Sparse Attn.2024.0919.69438.25
StreamingLLMTrainable Parameters=0M, Context Window=4M, Extension Method=Sparse Attn.2024.0914.53596.87
LongLLMLinguaTrainable Parameters=0M, Context Window=40K, Extension Method=Hard Comp.2024.0914.0176.06
Llama2-7B-chatTrainable Parameters=0M, Context Window=4K, Extension Method=-2024.0912.061,956.51
RAGTrainable Parameters=0M, Context Window=+∞, Extension Method=Hard Comp.2024.0911.1598.96