Multi-modal Needle In A Haystack on MM-NIAH 64K
74.83Retrieval Score (Ret.)MMProLong
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MMProLong2026.05 | 74.83 | 27.67 | 67.33 | 56.61 | |
| InternVL3-8B2026.05 | 67.67 | 14.33 | 59.33 | 47.11 | |
| Gemma3-12B2026.05 | 65.58 | 27 | 42.25 | 44.94 | |
| InternVL3.5-8B2026.05 | 56.12 | 4.45 | 57.23 | 39.26 | |
| Qwen2.5-VL-7B2026.05 | 50 | 6 | 27.5 | 27.83 | |
| Gemma3-4B2026.05 | 43.25 | 4.33 | 31.5 | 26.36 |