Real World Visual Reasoning on MEGA
54.7AccuracyGemini 2.0 Flash
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.0 FlashZero-shot=true2026.02 | 54.7 | |
| Qwen2.5-VL-32B + AT-RL (Ours)Zero-shot=true2026.02 | 53 | |
| OpenAI GPT-4oZero-shot=true2026.02 | 52.7 | |
| Claude 3.5 SonnetZero-shot=true2026.02 | 52.5 | |
| Qwen2.5-VL-32B + VPPOZero-shot=true2026.02 | 52.3 | |
| Qwen2.5-VL-72B InstructZero-shot=true2026.02 | 49.6 | |
| Qwen2.5-VL-32B InstructZero-shot=true2026.02 | 48.9 | |
| Llama 4 ScoutZero-shot=true2026.02 | 31.8 |