List your company
ResearchFormerly WizWand

Long-context Question Answering on LongBench N=162

31.5F1 ScoreRef. ceiling
-0.8447.55315.9524.347May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Ref. ceilingCache capacity (C)=256, Backbone=Qwen2.5-3B2026.0531.5100
H2O-faithful+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Implementation=Faithful reproduction, Backbone=Qwen2.5-3B2026.053095.4
SnapKV-faithful+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Implementation=Faithful reproduction, Backbone=Qwen2.5-3B2026.0529.995.1
H2O+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0529.8—
SnapKV+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0529.8—
Ada-KV+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0529.8—
QUEST+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0529.8—
H2O+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.052991.9
SnapKV+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.052991.9
Ada-KV+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.052991.9
QUEST+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.052991.9
Random+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0528.9—
LRU+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0528.5—
LRU+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0528.289.4
Random+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.052579.5
H2O+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0523—
SnapKV+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0523—
Ada-KV+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0523—
QUEST+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0523—
LRU+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0522.9—
Random+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0522.5—
SLW+protCache capacity (C)=512, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0519.8—
SLW+protCache capacity (C)=256, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0518.458.5
SLW+protCache capacity (C)=128, Protection=10% prefix + 10% suffix, Backbone=Qwen2.5-3B2026.0512.4—
H2OCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.053.812.2
H2OCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.053.8—
SnapKVCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.053.812
SnapKVCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.053.7—
RandomCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.053.5—
H2OCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.053—
SnapKVCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.053—
SLWCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.053—
SLWCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.052.78.4
RandomCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.052.78.5
SLWCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.052.1—
LRUCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.051.9—
LRUCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.051.13.6
QUESTCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.051.1—
LRUCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.051—
RandomCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.9—
QUESTCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.82.4
Ada-KVCache capacity (C)=256, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.51.6
Ada-KVCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.5—
Ada-KVCache capacity (C)=128, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.4—
QUESTCache capacity (C)=512, Protection=Without protection, Backbone=Qwen2.5-3B2026.050.4—