Robustness Evaluation on R-Bench 2024 (test)
73.53MCQ Accuracy (low)Robust-U1
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Robust-U1Category=Ours2026.06 | 73.53 | 73.29 | 67.68 | 70.67 | 71.64 | 69.34 | 82.72 | 80.59 | 76.4 | 73.98 | |
| BAGELCategory=General MLLM2026.06 | 71.76 | 65.84 | 57.93 | 64.97 | 61.27 | 61.5 | 46.85 | 46.33 | 42.88 | 57.7 | |
| Robust-R1Category=Robust MLLM2026.06 | 65.29 | 63.91 | 60.97 | 49.14 | 49.09 | 49.8 | 40.68 | 37.81 | 34.84 | 50.17 | |
| Qwen2.5-VL-3BCategory=General MLLM2026.06 | 64.11 | 60.22 | 57.32 | 48.72 | 48.54 | 49.04 | 37.78 | 37.04 | 33.3 | 48.45 | |
| InternVL-4BCategory=General MLLM2026.06 | 62.35 | 60.24 | 59.14 | 49.82 | 45.39 | 51.08 | 36.67 | 30.41 | 28.51 | 47.06 | |
| Gemma3-4BCategory=General MLLM2026.06 | 58.23 | 57.76 | 50.6 | 48.65 | 46.3 | 44.19 | 40.48 | 37.46 | 34.8 | 46.49 | |
| Robust CLIPCategory=Robust MLLM2026.06 | 47.05 | 46.58 | 40.24 | 45.03 | 43.39 | 47.43 | 22.9 | 22.19 | 19.83 | 37.18 | |
| TeCoACategory=Robust MLLM2026.06 | 46.47 | 42.23 | 40.24 | 46.87 | 39.94 | 44.61 | 21.11 | 21.95 | 19.37 | 35.86 | |
| Robust LLaVACategory=Robust MLLM2026.06 | 33.52 | 26.08 | 30.48 | 26.07 | 22.12 | 24.43 | 0.68 | 0.65 | 0.67 | 18.3 |