Visual Discrepancy Detection on OddGridBench
91.33Color AccuracyHuman
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| HumanModel Category=Human Performance2026.03 | 91.33 | 69.33 | 82.67 | 78 | 96 | 97.33 | 97.67 | 87.47 | |
| OddGrid-GRPO2026.03 | 89.5 | 64.5 | 80.5 | 64.5 | 90.5 | 91.5 | 97.5 | 82.64 | |
| GRPO2026.03 | 88.5 | 44 | 67.5 | 41.5 | 78.5 | 83 | 93 | 70.86 | |
| OddGrid-GRPOdistance reward=disabled2026.03 | 87.5 | 44.5 | 67 | 45.5 | 80.5 | 91 | 91.5 | 72.5 | |
| OddGrid-GRPOcurriculum-guided scheduling=disabled2026.03 | 87.5 | 60.5 | 69 | 64 | 84 | 88.5 | 95.5 | 78.43 | |
| Qwen3-VL-32BModel Category=Open-source MLLMs2026.03 | 85 | 39.5 | 52.5 | 39 | 76.5 | 89.5 | 94.5 | 68.07 | |
| Gemini-2.5-ProModel Category=Proprietary MLLMs2026.03 | 82.5 | 9.5 | 26 | 6.5 | 56.5 | 76 | 88 | 49.29 | |
| Qwen3-VL-4BModel Category=Open-source MLLMs2026.03 | 73 | 28 | 39 | 27.5 | 56 | 70.5 | 73 | 52.43 | |
| Qwen3-VL-8BModel Category=Open-source MLLMs2026.03 | 72 | 20.5 | 35.5 | 19 | 55.5 | 67 | 71.5 | 48.71 | |
| GSPO2026.03 | 70 | 55 | 81.5 | 59 | 85.5 | 85.5 | 95 | 75.93 | |
| Gemini-2.5-FlashModel Category=Proprietary MLLMs2026.03 | 70 | 7 | 21 | 5 | 48.5 | 54.5 | 72.5 | 39.79 | |
| Qwen3-VL-30B (Moe)Model Category=Open-source MLLMs2026.03 | 62.5 | 21 | 20.5 | 25 | 47 | 52.5 | 62 | 41.5 | |
| GPT-5Model Category=Proprietary MLLMs2026.03 | 56.5 | 9.5 | 21 | 5 | 29 | 35.5 | 46 | 28.93 | |
| Gemini-2.0-FlashModel Category=Proprietary MLLMs2026.03 | 53.5 | 5 | 16 | 5 | 32.5 | 43.5 | 47.5 | 29 | |
| InternVL3.5-38BModel Category=Open-source MLLMs2026.03 | 45.5 | 2 | 16 | 10 | 29.5 | 37 | 49.5 | 27.07 | |
| SAIL-VL2-8BModel Category=Open-source MLLMs2026.03 | 45 | 2.5 | 5 | 2.5 | 21.5 | 24 | 30.5 | 18.71 | |
| LLaVA-OneVision-1.5-8BModel Category=Open-source MLLMs2026.03 | 39.5 | 7.5 | 9 | 4.5 | 21 | 37 | 47.5 | 23.71 | |
| LLaVA-OneVision-1.5-4BModel Category=Open-source MLLMs2026.03 | 27.5 | 3 | 7.5 | 1 | 14 | 17.5 | 26 | 13.79 | |
| Molmo-72BModel Category=Open-source MLLMs2026.03 | 25.5 | 2 | 7 | 1 | 12 | 12 | 17.5 | 11 | |
| Qwen2.5-VL-72BModel Category=Open-source MLLMs2026.03 | 25 | 1 | 5 | 2.5 | 10.5 | 17.5 | 17.5 | 11.29 | |
| Baseline2026.03 | 23 | 5 | 12.5 | 7 | 19 | 22.5 | 31 | 17.14 | |
| Qwen3-VL-2BModel Category=Open-source MLLMs2026.03 | 23 | 5 | 12.5 | 7 | 19 | 22.5 | 31 | 17.14 | |
| SAIL-VL2-2BModel Category=Open-source MLLMs2026.03 | 13.5 | 2.5 | 3 | 2 | 7.5 | 5 | 9.5 | 6.14 | |
| LLaVA-v1.6-34BModel Category=Open-source MLLMs2026.03 | 3.5 | 2 | 2.5 | 2.5 | 3 | 3 | 2.5 | 2.71 | |
| RandomModel Category=Baseline2026.03 | 2 | 2 | 2 | 2 | 1.5 | 4 | 3.5 | 2.43 | |
| Phi-3.5-visionModel Category=Open-source MLLMs2026.03 | 2 | 2 | 2 | 1.5 | 1.5 | 1.5 | 2 | 1.79 | |
| Qwen2.5-VL-7BModel Category=Open-source MLLMs2026.03 | 2 | 1.5 | 0.5 | 0 | 2.5 | 2.5 | 5 | 2 |