Visual Information Retrieval on ImageNeedle v1.0 (test)
96.56ScoreFull Cache
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Full CacheBackbone=Qwen2.5-VL-32B, KV Budget=Full2026.04 | 96.56 | 70.99 | — | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=40962026.04 | 85 | 64.28 | 1.24 | |
| Full CacheBackbone=InternVL3.5-14B, KV Budget=Full2026.04 | 84.06 | 68.95 | — | |
| Full CacheBackbone=Qwen2.5-VL-7B, KV Budget=Full2026.04 | 83.7 | 65.52 | — | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=40962026.04 | 83.13 | 64.03 | 3.43 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=40962026.04 | 81.56 | 64.47 | 1.05 | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=40962026.04 | 80.94 | 66.5 | 0.96 | |
| Full CacheBackbone=InternVL3.5-8B, KV Budget=Full2026.04 | 80.31 | 67.46 | — | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=20482026.04 | 80.31 | 66.5 | 0.96 | |
| SnapKVBackbone=InternVL3.5-8B, KV Budget=10242026.04 | 80 | 66.68 | 0.78 | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=20482026.04 | 79.69 | 65.23 | 2.23 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=20482026.04 | 78.44 | 60.62 | 4.9 | |
| KeyDiffBackbone=InternVL3.5-14B, KV Budget=10242026.04 | 75.94 | 60.01 | 8.84 | |
| KeyDiffBackbone=InternVL3.5-8B, KV Budget=10242026.04 | 74.06 | 62.76 | 4.7 | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=20482026.04 | 72.19 | 61.31 | 4.21 | |
| KeyDiffBackbone=Qwen2.5-VL-32B, KV Budget=10242026.04 | 67.19 | 59.96 | 11.03 | |
| KeyDiffBackbone=Qwen2.5-VL-7B, KV Budget=10242026.04 | 66.25 | 55.82 | 9.7 | |
| SnapKVBackbone=InternVL3.5-14B, KV Budget=10242026.04 | 66.25 | 63.26 | 7.73 | |
| SnapKVBackbone=Qwen2.5-VL-32B, KV Budget=10242026.04 | 66.25 | 63.26 | 7.73 | |
| SnapKVBackbone=Qwen2.5-VL-7B, KV Budget=10242026.04 | 45.31 | 54.46 | 11.06 |