List your company
ResearchFormerly WizWand

Long-context Question Answering on NarrativeQA Fixed Chunk 2048

32.64ScoreBaseline
10.519216.262122.00527.7479Mar 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
BaselineModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0332.64
OurModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0332.39
Our + ReorderModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0331.4
CacheBlendModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0329.7
EPIC (15%)Model=ChatGLM, Setting=Fixed Chunk (2048)2026.0329.62
Our + ReorderModel=LLaMA, Setting=Fixed Chunk (2048)2026.0329.57
OurModel=LLaMA, Setting=Fixed Chunk (2048)2026.0328.91
No RecomputeModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0327.58
EPIC (15%)Model=LLaMA, Setting=Fixed Chunk (2048)2026.0327.01
CacheBlendModel=LLaMA, Setting=Fixed Chunk (2048)2026.0326.85
No RecomputeModel=LLaMA, Setting=Fixed Chunk (2048)2026.0326.39
Our + ReorderModel=Qwen, Setting=Fixed Chunk (2048)2026.0322.51
CacheBlendModel=Qwen, Setting=Fixed Chunk (2048)2026.0321.7
OurModel=Qwen, Setting=Fixed Chunk (2048)2026.0321.1
EPIC (15%)Model=Qwen, Setting=Fixed Chunk (2048)2026.0319.99
BaselineModel=Qwen, Setting=Fixed Chunk (2048)2026.0316.54
BaselineModel=LLaMA, Setting=Fixed Chunk (2048)2026.0316.23
No RecomputeModel=Qwen, Setting=Fixed Chunk (2048)2026.0311.37