Multi-image Understanding on MuirBench
74.5ScoreGemini 2.5 Flash
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 2.5 FlashSize=-, mode=instruct2026.04 | 74.5 | |
| MiniCPM-o 4.5Size=9B, mode=instruct2026.04 | 72 | |
| GPT-4o-20240513Model Name=GPT-4o-202405132024.12 | 68 | |
| Qwen3-VLSize=8B, mode=instruct2026.04 | 64.4 | |
| InternVL2.5-78BModel Name=InternVL2.5-78B2024.12 | 63.5 | |
| InternVL2.5-38BModel Name=InternVL2.5-38B2024.12 | 62.7 | |
| GPT-4VModel Name=GPT-4V2024.12 | 62.3 | |
| Qwen3-OmniSize=30B-A3B, mode=instruct2026.04 | 61.9 | |
| InternVL2.5-26BModel Name=InternVL2.5-26B2024.12 | 61.1 | |
| InternVL3.5Size=8B, mode=instruct2026.04 | 55.8 | |
| LLaVA-OneVision-72BModel Name=LLaVA-OneVision-72B2024.12 | 54.8 | |
| InternVL2-40BModel Name=InternVL2-40B2024.12 | 54.4 | |
| InternVL2-Llama3-76BModel Name=InternVL2-Llama3-76B2024.12 | 51.2 | |
| InternVL2.5-8BModel Name=InternVL2.5-8B2024.12 | 51.1 | |
| InternVL2-26BModel Name=InternVL2-26B2024.12 | 50.6 | |
| InternVL2-8BModel Name=InternVL2-8B2024.12 | 48.7 | |
| InternVL2.5-4BModel Name=InternVL2.5-4B2024.12 | 45.2 | |
| Full ModelSparsity Ratio=0%, Base Model=LLaVA-OneVision2025.04 | 41.8 | |
| Full ModelBackbone=LLaVA-OneVision, Sparsity Ratio=0%2026.04 | 41.8 | |
| TopoVLMBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 41.3 | |
| SparseGPTSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 41.1 | |
| SparseGPTBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 41.1 | |
| TAMPSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 40.9 | |
| TAMPBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 40.9 | |
| ECOFLaPSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 40.7 | |
| ECoFLaPBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 40.7 | |
| InternVL2.5-2BModel Name=InternVL2.5-2B2024.12 | 40.6 | |
| InternVL2-4BModel Name=InternVL2-4B2024.12 | 40.5 | |
| LLM-StreamlineBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 39.2 | |
| WandaSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 38.6 | |
| WandaBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 38.6 | |
| InternVL-Chat-V1.5Model Name=InternVL-Chat-V1.52024.12 | 38.5 | |
| LLM-PrunerBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 36.9 | |
| OWLSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 35.1 | |
| OWLBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 35.1 | |
| InternVL2-2BModel Name=InternVL2-2B2024.12 | 32.5 | |
| InternVL2.5-1BModel Name=InternVL2.5-1B2024.12 | 29.9 | |
| InternVL2-1BModel Name=InternVL2-1B2024.12 | 29.3 | |
| LLaVA-OneVision-0.5BModel Name=LLaVA-OneVision-0.5B2024.12 | 25.5 | |
| MagnitudeSparsity Ratio=60%, Base Model=LLaVA-OneVision2025.04 | 0 | |
| MagnitudeBackbone=LLaVA-OneVision, Sparsity Ratio=60%2026.04 | 0 |