Multi-image Multi-modal Question Answering on MileBench
44.76CL-CH ScoreFULL CACHE
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| FULL CACHEModel=LLaVA-OV-7B, KV Cache Compression Strategy=FULL CACHE2026.04 | 44.76 | 97 | 53.5 | 77 | 77.5 | 31.23 | 76.5 | 88 | 68.18 | |
| HYBRIDKVModel=LLaVA-OV-7B, KV Cache Compression Strategy=HYBRIDKV2026.04 | 44.31 | 97 | 52.5 | 77 | 77.5 | 30.71 | 76.5 | 88 | 67.94 | |
| LOOK-MModel=LLaVA-OV-7B, KV Cache Compression Strategy=LOOK-M2026.04 | 44.15 | 97 | 51 | 77 | 77.5 | 30.57 | 76.5 | 87.5 | 67.65 | |
| SNAPKVModel=LLaVA-OV-7B, KV Cache Compression Strategy=SNAPKV2026.04 | 44.13 | 97 | 51.5 | 77 | 77.5 | 30.17 | 76.5 | 87.5 | 67.66 | |
| SPARSEMMModel=LLaVA-OV-7B, KV Cache Compression Strategy=SPARSEMM2026.04 | 43.72 | 97 | 52.5 | 77 | 77.5 | 30.56 | 76.5 | 86.5 | 67.66 | |
| MADAKVModel=LLaVA-OV-7B, KV Cache Compression Strategy=MADAKV2026.04 | 43.37 | 97 | 52 | 77 | 77.5 | 30.69 | 76.5 | 87.5 | 67.7 | |
| FULL CACHEModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=FULL CACHE2026.04 | 43.07 | 97.5 | 66.5 | 75 | 83.5 | 29.79 | 76.5 | 92.5 | 70.55 | |
| HYBRIDKVModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=HYBRIDKV2026.04 | 40.57 | 97.5 | 63 | 76 | 83.5 | 29.84 | 76 | 93 | 69.93 | |
| LOOK-MModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=LOOK-M2026.04 | 38.81 | 97.5 | 52.5 | 73.5 | 82.5 | 29.25 | 71 | 88 | 66.63 | |
| FULL CACHEModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=FULL CACHE2026.04 | 38.34 | 96 | 56.5 | 80 | 80 | 29.37 | 72 | 88 | 67.53 | |
| MADAKVModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=MADAKV2026.04 | 37.86 | 97.5 | 55 | 74.5 | 82 | 28.24 | 70.5 | 90 | 66.95 | |
| HYBRIDKVModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=HYBRIDKV2026.04 | 37.75 | 96 | 51 | 79.5 | 80 | 29.22 | 72 | 88 | 66.68 | |
| SPARSEMMModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=SPARSEMM2026.04 | 37.63 | 97.5 | 62 | 75.5 | 83.5 | 28.69 | 70.5 | 92.5 | 68.48 | |
| SNAPKVModel=Qwen2.5-VL-7B, KV Cache Compression Strategy=SNAPKV2026.04 | 37.41 | 97.5 | 54 | 73 | 83 | 29.02 | 71 | 89.5 | 66.8 | |
| LOOK-MModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=LOOK-M2026.04 | 35.12 | 96 | 42.5 | 79 | 80 | 26.24 | 66.5 | 83.5 | 63.61 | |
| SPARSEMMModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=SPARSEMM2026.04 | 35.05 | 96 | 50.5 | 79 | 79.5 | 26.8 | 65 | 87 | 64.86 | |
| SNAPKVModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=SNAPKV2026.04 | 34.78 | 96 | 43 | 78.5 | 80 | 26.16 | 68 | 83.5 | 63.74 | |
| MADAKVModel=Qwen2.5-VL-3B, KV Cache Compression Strategy=MADAKV2026.04 | 33.66 | 96 | 43.5 | 79.5 | 80 | 26.02 | 66 | 84 | 63.59 |