List your company
ResearchFormerly WizWand

Long-context Question Answering on MuSiQue Fixed Chunk 2048

39.46ScoreBaseline
12.378419.409226.4433.4708Mar 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
BaselineModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0339.46
Our + ReorderModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0337.86
BaselineModel=Qwen, Setting=Fixed Chunk (2048)2026.0337.18
OurModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0336.88
OurModel=Qwen, Setting=Fixed Chunk (2048)2026.0333.84
BaselineModel=LLaMA, Setting=Fixed Chunk (2048)2026.0332.85
OurModel=LLaMA, Setting=Fixed Chunk (2048)2026.0331.04
Our + ReorderModel=LLaMA, Setting=Fixed Chunk (2048)2026.0330.44
EPIC (15%)Model=ChatGLM, Setting=Fixed Chunk (2048)2026.0329.02
Our + ReorderModel=Qwen, Setting=Fixed Chunk (2048)2026.0328.72
No RecomputeModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0328.33
CacheBlendModel=LLaMA, Setting=Fixed Chunk (2048)2026.0328.23
EPIC (15%)Model=LLaMA, Setting=Fixed Chunk (2048)2026.0326.38
CacheBlendModel=ChatGLM, Setting=Fixed Chunk (2048)2026.0326.24
CacheBlendModel=Qwen, Setting=Fixed Chunk (2048)2026.0326.11
No RecomputeModel=LLaMA, Setting=Fixed Chunk (2048)2026.0325.23
EPIC (15%)Model=Qwen, Setting=Fixed Chunk (2048)2026.0323.68
No RecomputeModel=Qwen, Setting=Fixed Chunk (2048)2026.0313.42