Code Analysis on LongBench
70.64Lcc ScoreFullKV
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FullKVBackbone=Qwen3-8B, KV Cache Size=Full2026.03 | 70.64 | 59.26 | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 67.99 | 53.77 | |
| DapQBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 67.2 | 53.83 | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 67.01 | 50.11 | |
| DapQBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 66.29 | 52.03 | |
| H2OBackbone=Qwen3-8B, KV Cache Size=2562026.03 | 66.11 | 53.93 | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 65.36 | 51.65 | |
| H2OBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 65.22 | 52.77 | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 62.78 | 55.64 | |
| FullKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=Full2026.03 | 61.97 | 59.97 | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 61.81 | 53.92 | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 61.78 | 54.92 | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 61.49 | 53.36 | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 61.49 | 52.4 | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=2562026.03 | 61.34 | 52.51 | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=1282026.03 | 60.82 | 48.78 | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 60.36 | 52.03 | |
| DapQBackbone=Qwen3-8B, KV Cache Size=642026.03 | 60.31 | 46.9 | |
| DapQBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 60.19 | 49.9 | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=1282026.03 | 59.81 | 53.14 | |
| PyramidKVBackbone=Qwen3-8B, KV Cache Size=642026.03 | 59.73 | 46.48 | |
| H2OBackbone=Qwen3-8B, KV Cache Size=642026.03 | 59.48 | 48.95 | |
| H2OBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 59.2 | 51.1 | |
| FullKVBackbone=Llama3-8B-Instruct, KV Cache Size=Full2026.03 | 58.96 | 52.71 | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 58.4 | 53.82 | |
| SnapKVBackbone=Qwen3-8B, KV Cache Size=642026.03 | 57.96 | 46.49 | |
| SnapKVBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 57.95 | 50.91 | |
| CompilerKVModel=LLaMA-3-8B-Instruct, KV cache size=1282026.02 | 57.91 | 53.94 | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 57.07 | 54.09 | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 56.87 | 54.36 | |
| PyramidKVBackbone=Llama3-8B-Instruct, KV Cache Size=642026.03 | 55.19 | 47.9 | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 54.46 | 51.7 | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 53.97 | 51.52 | |
| CompilerKVModel=Qwen2-7B-Instruct, KV cache size=1282026.02 | 53.44 | 52.79 | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=2562026.03 | 52.61 | 49.49 | |
| CompilerKVModel=Mistral-7B-Instruct-v0.2, KV cache size=1282026.02 | 52.3 | 47.6 | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 52.14 | 51.39 | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=1282026.03 | 49.45 | 46.9 | |
| H2OBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 49.44 | 45.52 | |
| DapQBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 49.38 | 46.77 | |
| CompilerKVModel=InternLM-2.5-Chat-1M, KV cache size=1282026.02 | 49.28 | 47.42 | |
| SnapKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 46.16 | 45.75 | |
| PyramidKVBackbone=Qwen2.5-7B-Instruct, KV Cache Size=642026.03 | 44.67 | 42.22 |