Visual Reasoning on A-OKVQA
5.4ECEAvg(VF, Contr.)
Evaluation Results
| Method | Links | |
|---|---|---|
| Avg(VF, Contr.)Model=Qwen2.52025.09 | 5.4 | |
| Avg(VF, Contr.)Model=Avg2025.09 | 8.4 | |
| Avg(VF, Contr.)Model=GPT-4o2025.09 | 9 | |
| Visual FidelityModel=GPT-4o2025.09 | 9.9 | |
| Avg(VF, Contr.)Model=LLaVA2025.09 | 10.9 | |
| ContrastivenessModel=Qwen2.52025.09 | 13.6 | |
| Visual FidelityModel=Qwen2.52025.09 | 13.7 | |
| Visual FidelityModel=Avg2025.09 | 14.4 | |
| Min(VF, Contr.)Model=Qwen2.52025.09 | 14.4 | |
| Min(VF, Contr.)Model=LLaVA2025.09 | 14.7 | |
| InformativenessModel=Qwen2.52025.09 | 15.2 | |
| Prod(VF, Contr.)Model=Qwen2.52025.09 | 15.4 | |
| PlausibilityModel=LLaVA2025.09 | 16.2 | |
| Prod(VF, Contr.)Model=LLaVA2025.09 | 16.4 | |
| Min(VF, Contr.)Model=Avg2025.09 | 17.3 | |
| ContrastivenessModel=Avg2025.09 | 17.4 | |
| ContrastivenessModel=LLaVA2025.09 | 17.6 | |
| Prod(VF, Contr.)Model=Avg2025.09 | 18.4 | |
| Visual FidelityModel=LLaVA2025.09 | 19.7 | |
| ContrastivenessModel=GPT-4o2025.09 | 21 | |
| SimulatabilityModel=Qwen2.52025.09 | 21.9 | |
| Min(VF, Contr.)Model=GPT-4o2025.09 | 22.7 | |
| InformativenessModel=GPT-4o2025.09 | 22.8 | |
| Prod(VF, Contr.)Model=GPT-4o2025.09 | 23.3 | |
| InformativenessModel=Avg2025.09 | 23.7 | |
| PlausibilityModel=Avg2025.09 | 25 | |
| SimulatabilityModel=Avg2025.09 | 27 | |
| PlausibilityModel=Qwen2.52025.09 | 27 | |
| SimulatabilityModel=LLaVA2025.09 | 28.8 | |
| SimulatabilityModel=GPT-4o2025.09 | 30.2 | |
| PlausibilityModel=GPT-4o2025.09 | 31.7 | |
| InformativenessModel=LLaVA2025.09 | 33.2 |