EM Perception (SPE) on PReD-Bench
97.1MCQAPReD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PReD2026.03 | 97.1 | 81.9 | |
| gemini-2.5 pro2026.03 | 56.3 | 12 | |
| claude sonnet-42026.03 | 48.5 | 2.8 | |
| GPT-52026.03 | 42.9 | 13.3 | |
| seed-1.6 vision2026.03 | 40.4 | 3.1 | |
| qwen3-vl-235b-a22bInstruction-tuned=true2026.03 | 30.4 | 2 | |
| qwen2.5-vl-7bInstruction-tuned=true2026.03 | 20.5 | 0.1 | |
| qwen3-vl-8bInstruction-tuned=true2026.03 | 18.8 | 2 |