Compositional Reasoning on VisMin Easy (test)
94.88Text ScoreQwen3-VL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-VLModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 94.88 | 93.24 | 90.34 | |
| Qwen3-VL + FOCUSModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 94.79 | 93.5 | 90.51 | |
| InternVL3 + FOCUSModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 94.7 | 83.05 | 80.83 | |
| InternVL3Model Size=≥7B, Evaluation protocol=Frozen state2025.08 | 94.62 | 84.84 | 81.6 | |
| Qwen3-VL + FOCUSModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 94.28 | 92.06 | 88.8 | |
| Qwen3-VLModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 94.2 | 90.68 | 87.35 | |
| Qwen2.5-VLModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 93.85 | 92.65 | 88.55 | |
| Qwen2.5-VL + FOCUSModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 93.85 | 92.57 | 88.72 | |
| LLaVA-OVModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 93.43 | 62.99 | 60.68 | |
| LLaVA-OV + FOCUSModel Size=≥7B, Evaluation protocol=Frozen state2025.08 | 93.43 | 64.14 | 62 | |
| InternVL3 + FOCUSModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 93.34 | 74.33 | 71.26 | |
| InternVL3Model Size=<7B, Evaluation protocol=Frozen state2025.08 | 93.25 | 29.96 | 29.36 | |
| Qwen2.5-VLModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 92.14 | 47.74 | 46.2 | |
| Qwen2.5-VL + FOCUSModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 92.06 | 56.92 | 55.82 | |
| LLaVA-OVModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 20.98 | 9.26 | 1.55 | |
| LLaVA-OV + FOCUSModel Size=<7B, Evaluation protocol=Frozen state2025.08 | 20.98 | 27.01 | 8.42 |