Visual Reasoning on MMMU-Pro (Discriminability)
19.5DiscriminabilitySimulatability
Evaluation Results
| Method | Links | |
|---|---|---|
| SimulatabilityModel=Qwen2.52025.09 | 19.5 | |
| Visual FidelityModel=LLaVA2025.09 | 16.9 | |
| ContrastivenessModel=Qwen2.52025.09 | 15.4 | |
| Prod(VF, Contr.)Model=Qwen2.52025.09 | 14.6 | |
| Prod(VF, Contr.)Model=GPT-4o2025.09 | 14.3 | |
| Min(VF, Contr.)Model=Qwen2.52025.09 | 12.7 | |
| Min(VF, Contr.)Model=GPT-4o2025.09 | 12.4 | |
| Avg(VF, Contr.)Model=LLaVA2025.09 | 10.8 | |
| ContrastivenessModel=GPT-4o2025.09 | 10.1 | |
| Avg(VF, Contr.)Model=Qwen2.52025.09 | 9.6 | |
| Avg(VF, Contr.)Model=GPT-4o2025.09 | 9.6 | |
| Visual FidelityModel=GPT-4o2025.09 | 9 | |
| Prod(VF, Contr.)Model=LLaVA2025.09 | 9 | |
| Min(VF, Contr.)Model=LLaVA2025.09 | 8.2 | |
| SimulatabilityModel=GPT-4o2025.09 | 7.9 | |
| SimulatabilityModel=LLaVA2025.09 | 5.9 | |
| ContrastivenessModel=LLaVA2025.09 | 4.7 | |
| Visual FidelityModel=Qwen2.52025.09 | 3.8 | |
| PlausibilityModel=Qwen2.52025.09 | 1.2 | |
| InformativenessModel=GPT-4o2025.09 | 1.1 | |
| InformativenessModel=LLaVA2025.09 | 0.8 | |
| InformativenessModel=Qwen2.52025.09 | 0.6 | |
| PlausibilityModel=LLaVA2025.09 | 0.6 | |
| PlausibilityModel=GPT-4o2025.09 | 0.4 |