Visual Question Answering on VMCBench
83.56Gen. AccMM-Eureka
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MM-EurekaClueTracer=true2026.02 | 83.56 | 67.26 | 94.05 | 58.38 | 85.93 | 80.31 | 7.26 | |
| Ocean-R1ClueTracer=true2026.02 | 83.51 | 66.99 | 97.19 | 53.36 | 85.11 | 80.32 | 10.6 | |
| ORSTA-R1ClueTracer=true2026.02 | 81.52 | 64.21 | 94.41 | 51.11 | 84.63 | 78.39 | 7.3 | |
| Ocean-R1ClueTracer=false2026.02 | 77.74 | 61.69 | 88.91 | 46.25 | 76.58 | 73.75 | — | |
| MM-EurekaClueTracer=false2026.02 | 76.31 | 58.79 | 90.46 | 42.44 | 76.21 | 72.44 | — | |
| R1-OneVisionClueTracer=true2026.02 | 76.11 | 61.81 | 89.97 | 51.21 | 78.88 | 73.91 | 22.2 | |
| ORSTA-R1ClueTracer=false2026.02 | 71.55 | 55.62 | 85.06 | 42.82 | 72.6 | 68.39 | — | |
| R1-OneVisionClueTracer=false2026.02 | 56.64 | 45.14 | 65.39 | 32.44 | 52.35 | 52.99 | — |