VLM-as-a-Judge on MLLM-as-a-Judge
75.78AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oConfiguration=BIRCH2026.04 | 75.78 | |
| Llama-3.2-Vision-90BConfiguration=BIRCH2026.04 | 75.12 | |
| Gemini-2.5-FlashConfiguration=BIRCH2026.04 | 73.37 | |
| Gemini-2.5-ProConfiguration=BIRCH2026.04 | 73.37 | |
| LLaVA-OneVision-1.5-8BConfiguration=BIRCH2026.04 | 71.17 | |
| Gemini-2.5-ProConfiguration=Standard Ref2026.04 | 69.21 | |
| Gemini-2.5-FlashConfiguration=Standard Ref2026.04 | 68.34 | |
| Gemini-2.5-ProConfiguration=Image Caption2026.04 | 68.04 | |
| Gemini-2.5-ProConfiguration=Base2026.04 | 67.63 | |
| Gemini-2.5-FlashConfiguration=Base2026.04 | 66.92 | |
| Gemini-2.5-FlashConfiguration=Image Caption2026.04 | 66.9 | |
| Llama-3.2-Vision-90BConfiguration=Image Caption2026.04 | 66.73 | |
| GPT-4oConfiguration=Base2026.04 | 66.45 | |
| LLaVA-OneVision-1.5-8BConfiguration=Standard Ref2026.04 | 66.21 | |
| GPT-4oConfiguration=Image Caption2026.04 | 65.79 | |
| LLaVA-OneVision-1.5-8BConfiguration=Image Caption2026.04 | 65.67 | |
| LLaVA-OneVision-1.5-8BConfiguration=Base2026.04 | 65.35 | |
| Llama-3.2-Vision-90BConfiguration=Base2026.04 | 65.28 | |
| GPT-4oConfiguration=Standard Ref2026.04 | 65.14 | |
| Llama-3.2-Vision-90BConfiguration=Standard Ref2026.04 | 63.18 | |
| Phi-4-multimodalConfiguration=BIRCH2026.04 | 63.11 | |
| LLaVA-1.6-34BConfiguration=BIRCH2026.04 | 61.54 | |
| LLaVA-1.5-13BConfiguration=BIRCH2026.04 | 59.48 | |
| Phi-4-multimodalConfiguration=Base2026.04 | 59.19 | |
| Phi-4-multimodalConfiguration=Standard Ref2026.04 | 59.11 | |
| Phi-4-multimodalConfiguration=Image Caption2026.04 | 59.07 | |
| LLaVA-1.6-34BConfiguration=Base2026.04 | 58.95 | |
| LLaVA-1.6-34BConfiguration=Image Caption2026.04 | 58.88 | |
| LLaVA-1.6-34BConfiguration=Standard Ref2026.04 | 58.02 | |
| LLaVA-1.5-13BConfiguration=Base2026.04 | 56.21 | |
| LLaVA-1.5-13BConfiguration=Image Caption2026.04 | 54.69 | |
| LLaVA-1.5-13BConfiguration=Standard Ref2026.04 | 53.28 |