List your company
ResearchFormerly WizWand

Multi-image understanding on MileBench (test)

57.3Temporal Multi-Image Score (Task T)FlashCache
46.494449.299752.10554.9103Nov 20, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FlashCacheBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1157.366.2124.6919.5
SnapKVBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1157.0765.6122.3418.83
H2OBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1157.0164.7314.3218
StreamingLLMBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1156.7563.153.7519.33
Full CacheBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=1.02025.1156.5165.2127.1918.17
Full CacheBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=1.02025.1155.5969.1727.3514.17
StreamingLLMBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5967.519.6914
H2OBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5968.612.6614.67
SnapKVBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5968.2713.5915.33
MEDABackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5968.139.0714.5
FlashCacheBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5968.8526.7215.5
LOOK-MBackbone MLLM=Qwen2.5-VL-7B, KV Cache Retention Ratio=0.22025.1155.5567.511.8811.83
MEDABackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1151.8654.015.1614.5
LOOK-MBackbone MLLM=Qwen2.5-VL-32B, KV Cache Retention Ratio=0.22025.1151.0353.375.7813
Full CacheBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=1.02025.1146.9765.3327.0311.67
StreamingLLMBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9765.049.2212.17
H2OBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9765.2919.6912.33
SnapKVBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9765.2719.3712.17
LOOK-MBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9765.2318.611.83
FlashCacheBackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9765.4625.9412.83
MEDABackbone MLLM=LLaVA-OneVision-1.5-8B, KV Cache Retention Ratio=0.22025.1146.9165.0819.9712.33