List your company
ResearchFormerly WizWand

Long-context Question Answering on 2WikiMQA Fixed Chunk 2048

52.53QA ScoreBaseline
38.95842.481546.00549.5285Mar 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
BaselineModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0352.53
Our + ReorderModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0351.76
BaselineModel=Qwen, Setting=Fixed Chunk (2048)2026.0351.61
OurModel=Qwen, Setting=Fixed Chunk (2048)2026.0350.89
OurModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0350.64
Our + ReorderModel=Qwen, Setting=Fixed Chunk (2048)2026.0347.73
OurModel=LLaMA, Setting=Fixed Chunk (2048)2026.0346.35
BaselineModel=LLaMA, Setting=Fixed Chunk (2048)2026.0345.88
Our + ReorderModel=LLaMA, Setting=Fixed Chunk (2048)2026.0344.55
CacheBlendModel=Qwen, Setting=Fixed Chunk (2048)2026.0344.17
EPIC (15%)Model=ChatGLM, Setting=Fixed Chunk (2048)2026.0344.01
No RecomputeModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0343.7
EPIC (15%)Model=Qwen, Setting=Fixed Chunk (2048)2026.0343.21
CacheBlendModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0342.26
CacheBlendModel=LLaMA, Setting=Fixed Chunk (2048)2026.0341.31
EPIC (15%)Model=LLaMA, Setting=Fixed Chunk (2048)2026.0340.87
No RecomputeModel=LLaMA, Setting=Fixed Chunk (2048)2026.0339.69
No RecomputeModel=Qwen, Setting=Fixed Chunk (2048)2026.0339.48