List your company
ResearchFormerly WizWand

Long-Context Reasoning on InfiniteBench

36.51Overall ScoreFull KV
10.426817.198423.9730.7416Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full KVBackbone=Qwen2.5-14B, KV Cache Budget=Full2026.0636.51
SEKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0634.83
SentenceKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0632.17
SemantiCacheBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0631.42
ChunkKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0630.84
PyramidKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0629.37
Full KVBackbone=Llama-3.1-8B, KV Cache Budget=Full2026.0628.88
SnapKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0628.14
SEKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0627.94
SentenceKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0626.07
H2OBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0625.38
SemantiCacheBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0625.33
Full KVBackbone=Llama-3-8B, KV Cache Budget=Full2026.0625.27
SEKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0624.83
ChunkKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0624.71
PyramidKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0623.62
SentenceKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0623.14
Full KVBackbone=Mistral-7B, KV Cache Budget=Full2026.0622.77
SemantiCacheBackbone=Llama-3-8B, KV Cache Budget=10%2026.0622.47
SnapKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0622.47
StreamingLLMBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0622.17
ChunkKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0621.83
Full KVBackbone=Llama-3.2-3B, KV Cache Budget=Full2026.0621.16
SEKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0621.13
PyramidKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0620.81
H2OBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0620.14
SnapKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0619.73
SEKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0619.72
SentenceKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0619.47
SemantiCacheBackbone=Mistral-7B, KV Cache Budget=10%2026.0618.84
SentenceKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0618.34
ChunkKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0618.23
SemantiCacheBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0617.83
PyramidKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0617.44
H2OBackbone=Llama-3-8B, KV Cache Budget=10%2026.0617.43
StreamingLLMBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0617.31
ChunkKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0617.12
SnapKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0616.72
PyramidKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0616.43
SnapKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0615.84
H2OBackbone=Mistral-7B, KV Cache Budget=10%2026.0614.83
StreamingLLMBackbone=Llama-3-8B, KV Cache Budget=10%2026.0614.82
H2OBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0613.72
StreamingLLMBackbone=Mistral-7B, KV Cache Budget=10%2026.0612.64
StreamingLLMBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0611.43