Reasoning over rich modalities on DUDE
52.7AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oSize=-2026.05 | 52.7 | |
| GPT-4o-miniSize=-2026.05 | 46.5 | |
| MoCASize=7B2026.05 | 45.1 | |
| Qwen2.5-VL-InstructSize=72B2026.05 | 44.5 | |
| Pixel ReasonerSize=7B2026.05 | 44.5 | |
| Qwen2.5-VL-InstructSize=7B2026.05 | 41.8 | |
| DocopilotSize=8B2026.05 | 40.7 | |
| mPLUG-Owl3Size=7B2026.05 | 39.5 | |
| VL-RethinkerSize=7B2026.05 | 39.1 | |
| Llava-OVSize=7B2026.05 | 38.1 | |
| DeepEyesSize=7B2026.05 | 35.2 | |
| R1-VLSize=7B2026.05 | 25.4 |