Multimodal Reasoning on SPD-Faith Bench Easy 1.0
5Contradiction RateGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oModel Type=Proprietary2026.02 | 5 | |
| GLM-4.5VModel Type=Open-Source2026.02 | 8 | |
| Qwen3-VL-235B-A22BModel Type=Open-Source, Parameters=235B-A22B2026.02 | 10.5 | |
| Qwen3-VL-32BModel Type=Open-Source, Parameters=32B2026.02 | 16 | |
| Gemini-2.5-ProModel Type=Proprietary2026.02 | 16.5 | |
| Claude-4.5-HaikuModel Type=Proprietary2026.02 | 16.5 | |
| Qwen2.5-VL-72BModel Type=Open-Source, Parameters=72B2026.02 | 19 | |
| InternVL2.5-38BModel Type=Open-Source, Parameters=38B2026.02 | 19.2 | |
| Qwen2.5-VL-7BModel Type=Open-Source, Parameters=7B2026.02 | 23 | |
| MiniCPM-V-2.6Model Type=Open-Source2026.02 | 23 | |
| InternVL2.5-8BModel Type=Open-Source, Parameters=8B2026.02 | 32.5 | |
| DeepSeek-VL2Model Type=Open-Source2026.02 | 39.5 |