Multi-modal Video Evaluation on Video-MME Long v1.0 (test)
57.89ScoreFull Cache
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Full CacheBackbone=InternVL3.5-14B, KV Budget=Full2026.04 | 57.89 | 68.95 | — | |
| SnapKVBackbone=InternVL3.5-14B, KV Budget=10242026.04 | 56.45 | 63.26 | 7.73 | |
| SnapKVBackbone=Qwen2.5-VL-32B, KV Budget=10242026.04 | 56.45 | 63.26 | 7.73 | |
| Full CacheBackbone=Qwen2.5-VL-32B, KV Budget=Full2026.04 | 55.22 | 70.99 | — | |
| KeyDiffBackbone=Qwen2.5-VL-32B, KV Budget=10242026.04 | 54.56 | 59.96 | 11.03 | |
| Full CacheBackbone=InternVL3.5-8B, KV Budget=Full2026.04 | 53.89 | 67.46 | — | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=10242026.04 | 53.11 | 66.68 | 0.78 | |
| KeyDiffBackbone=InternVL3.5-14B, KV Budget=10242026.04 | 52.78 | 60.01 | 8.84 | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=40962026.04 | 52.33 | 66.5 | 0.96 | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=20482026.04 | 52.33 | 66.5 | 0.96 | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=10242026.04 | 52.22 | 62.76 | 4.7 | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=20482026.04 | 52 | 65.23 | 2.23 | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=40962026.04 | 51.33 | 64.03 | 3.43 | |
| Full CacheBackbone=Qwen2.5-VL-7B, KV Budget=Full2026.04 | 50 | 65.52 | — | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=10242026.04 | 49.56 | 54.46 | 11.06 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=40962026.04 | 49.33 | 64.47 | 1.05 | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=20482026.04 | 49.11 | 61.31 | 4.21 | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=40962026.04 | 48.77 | 64.28 | 1.24 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=20482026.04 | 48 | 60.62 | 4.9 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=10242026.04 | 46.55 | 55.82 | 9.7 |