Visual Reasoning on MMMU-Pro (ECE)
14.4ECEProd(VF, Contr.)
Evaluation Results
| Method | Links | |
|---|---|---|
| Prod(VF, Contr.)Model=LLaVA2025.09 | 14.4 | |
| Min(VF, Contr.)Model=LLaVA2025.09 | 15.4 | |
| Prod(VF, Contr.)Model=Avg2025.09 | 18.2 | |
| Prod(VF, Contr.)Model=GPT-4o2025.09 | 20 | |
| Min(VF, Contr.)Model=Avg2025.09 | 20.1 | |
| Prod(VF, Contr.)Model=Qwen2.52025.09 | 20.3 | |
| Min(VF, Contr.)Model=GPT-4o2025.09 | 21.5 | |
| InformativenessModel=LLaVA2025.09 | 21.6 | |
| ContrastivenessModel=LLaVA2025.09 | 22.1 | |
| Min(VF, Contr.)Model=Qwen2.52025.09 | 23.4 | |
| ContrastivenessModel=Avg2025.09 | 25.1 | |
| ContrastivenessModel=GPT-4o2025.09 | 25.6 | |
| PlausibilityModel=GPT-4o2025.09 | 27.2 | |
| ContrastivenessModel=Qwen2.52025.09 | 27.6 | |
| Avg(VF, Contr.)Model=GPT-4o2025.09 | 27.9 | |
| PlausibilityModel=LLaVA2025.09 | 31.8 | |
| PlausibilityModel=Avg2025.09 | 32.7 | |
| Avg(VF, Contr.)Model=Avg2025.09 | 34.3 | |
| SimulatabilityModel=GPT-4o2025.09 | 35.7 | |
| Avg(VF, Contr.)Model=LLaVA2025.09 | 36 | |
| Avg(VF, Contr.)Model=Qwen2.52025.09 | 38.9 | |
| PlausibilityModel=Qwen2.52025.09 | 39.1 | |
| SimulatabilityModel=Avg2025.09 | 40.7 | |
| Visual FidelityModel=GPT-4o2025.09 | 41.2 | |
| SimulatabilityModel=Qwen2.52025.09 | 41.8 | |
| SimulatabilityModel=LLaVA2025.09 | 44.6 | |
| InformativenessModel=Avg2025.09 | 48.7 | |
| Visual FidelityModel=Avg2025.09 | 50.1 | |
| Visual FidelityModel=Qwen2.52025.09 | 53.5 | |
| InformativenessModel=GPT-4o2025.09 | 53.8 | |
| Visual FidelityModel=LLaVA2025.09 | 55.8 | |
| InformativenessModel=Qwen2.52025.09 | 70.6 |