Multimodal Reasoning on BLINK
69.86AccuracyGPT-5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-53-run average=true2026.06 | 69.86 | — | |
| Qwen3-VL-8B3-run average=true2026.06 | 69.43 | — | |
| Qwen3-VL-32B3-run average=true2026.06 | 66.22 | — | |
| Qwen3-VL-8B-InstructParameters=8B, Instruct=true2026.05 | 63.3 | — | |
| InternVL3.5-38B3-run average=true2026.06 | 62.65 | — | |
| CAVE-7BParameters=7B2026.05 | 61.5 | — | |
| Visual-OPSD3-run average=true, Latency (s)=10.02026.06 | 61.44 | — | |
| GPT-4o3-run average=true2026.06 | 60.28 | — | |
| InternVL3.5-8BParameters=8B2026.05 | 59.8 | — | |
| InternVL3.5-8B3-run average=true2026.06 | 59.6 | — | |
| ThinkMorph3-run average=true, Latency (s)=142.82026.06 | 59.49 | — | |
| Qwen2.5-VLParameters=7B2026.05 | 58.5 | — | |
| PulseFocus (Qwen3-VL)Params=2B, Configuration=PulseFocus, Budget control=true2026.03 | 56.4 | 0.85 | |
| DeepEyes-7BParameters=7B2026.05 | 56.4 | — | |
| LLaVA-NeXTSOFA=true2025.03 | 55.92 | — | |
| Qwen3-VLParams=2B, Configuration=Baseline2026.03 | 55.55 | — | |
| Visual-OPSD-Noise3-run average=true, Latency (s)=14.92026.06 | 55.49 | — | |
| Text-only SFT3-run average=true, Latency (s)=28.52026.06 | 54.39 | — | |
| PulseFocus (InternVL3.5)Params=8B, Configuration=PulseFocus, Budget control=true2026.03 | 54.18 | 3.73 | |
| LLaVA-NeXTSOFA=false2025.03 | 53.34 | — | |
| MantisSOFA=true2025.03 | 53.19 | — | |
| MantisSOFA=false2025.03 | 51.41 | — | |
| InternVL3.5Params=8B, Configuration=Baseline2026.03 | 50.45 | — | |
| VILASOFA=true2025.03 | 50.29 | — | |
| VILASOFA=false2025.03 | 49.79 | — | |
| Idefics2SOFA=true2025.03 | 48.31 | — | |
| BAGEL-7B3-run average=true2026.06 | 47.66 | — | |
| Idefics2SOFA=false2025.03 | 45.78 | — | |
| InternVL2SOFA=true2025.03 | 43.26 | — | |
| Random Guessing2025.03 | 39.27 | — | |
| InternVL2SOFA=false2025.03 | 38.95 | — | |
| Janus-Pro-7B3-run average=true2026.06 | 38.51 | — | |
| Chameleon-7B3-run average=true2026.06 | 16.52 | — |