List your company
ResearchFormerly WizWand

Code Debugging on InfiniteBench code_debug 40k input cap

34.26AccuracyQwen3-4B
23.44426.25229.0631.868May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen3-4BBackbone=Qwen3-4B, Mode=Full KV, Input cap=40k2026.0534.26
NestedKVBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0534.01
NestedKVBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0533.76
SnapKVBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0532.49
StreamingLLMBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0532.49
KeyDiffBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0532.23
ExpAttnBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0531.98
StreamingLLMBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0531.98
KeyDiffBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0531.47
NestedKVBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0531.22
KeyDiffBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0530.96
ExpAttnBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0530.46
SnapKVBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0530.2
StreamingLLMBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0529.44
SnapKVBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0528.17
ExpAttnBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0528.17
PyramidKVBackbone=Qwen3-4B, Compression ratio (r)=0.75, Input cap=40k2026.0526.65
PyramidKVBackbone=Qwen3-4B, Compression ratio (r)=0.25, Input cap=40k2026.0526.4
PyramidKVBackbone=Qwen3-4B, Compression ratio (r)=0.50, Input cap=40k2026.0523.86