Pointwise Scoring on MLLM-as-a-Judge in-domain v1.0 (test)
80.2ImageDC ScoreLLaVA-Critic-72B
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LLaVA-Critic-72BParameters=72B2024.10 | 80.2 | 72.3 | 70.5 | 52.4 | 78.2 | 95.1 | 79 | 75.4 | |
| LLaVA-Critic-7B (v0.5)Parameters=7B, Version=v0.52024.10 | 73.7 | 71.8 | 57.1 | 49.4 | 78.9 | 93.2 | 74.6 | 71.2 | |
| LLaVA-Critic-7BParameters=7B2024.10 | 73.5 | 73.3 | 61.6 | 51 | 84.3 | 94 | 74.8 | 73.2 | |
| LLaVA-OV-72BParameters=72B2024.10 | 71.8 | 68 | 44.6 | 43.6 | 71.6 | 82.4 | 62 | 63.4 | |
| LLaVA-CriticBase Model=LLaVA-NeXT2024.10 | 67.3 | 70.6 | 58 | 52.9 | 82 | 93.6 | 74.8 | 71.3 | |
| LLaVA-NeXTBackbone=LLaMA-8B2024.10 | 26.2 | 31.7 | 14.7 | 21.1 | 34.5 | 15.6 | 47.2 | 27.3 | |
| Qwen2-VL-7B-InstructParameters=7B, Variant=Instruct2024.10 | 19.9 | 46.3 | 9.6 | 20.8 | 47.6 | 69.4 | 32.9 | 35.2 | |
| LLaMA3.2-11B-Vision-InstructParameters=11B, Variant=Vision-Instruct2024.10 | 6.9 | 45 | 22.4 | 35.6 | 49.9 | 53.1 | 38.7 | 35.9 | |
| LLaVA-OV-7BParameters=7B2024.10 | 5.6 | 34.9 | 25.1 | 33.5 | 53.3 | 59.2 | 43.3 | 36.4 |