Visual Reasoning on OpenWorld
93.6Direct AccuracyQwen2.5-VL 72B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-VL 72BModel size=72B2025.07 | 93.6 | 93.2 | 86.8 | 74.8 | |
| Human2025.07 | 91 | — | — | — | |
| Pixtral 12BModel size=12B2025.07 | 79.4 | 84.2 | 76 | 88 |
Loading the SOTA2 catalog…
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-VL 72BModel size=72B2025.07 | 93.6 | 93.2 | 86.8 | 74.8 | |
| Human2025.07 | 91 | — | — | — | |
| Pixtral 12BModel size=12B2025.07 | 79.4 | 84.2 | 76 | 88 |