Visual Question Answering on OK-VQA (EM, F1)
44.29EMMUIER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MUIERModel=Qwen2.5-VL-7B2026.03 | 44.29 | 48.76 | |
| RICESModel=Qwen2.5-VL-7B2026.03 | 43.66 | 48.32 | |
| CIRCLESModel=Qwen2.5-VL-7B2026.03 | 43.54 | 48.53 | |
| MMICESModel=Qwen2.5-VL-7B2026.03 | 43.4 | 47.66 | |
| CIRCLESModel=Qwen2.5-VL-3B2026.03 | 43.24 | 47.27 | |
| RICESModel=Qwen2.5-VL-3B2026.03 | 42.57 | 46.26 | |
| NoneModel=Qwen2.5-VL-3B2026.03 | 42.29 | 46.12 | |
| MUIERModel=Qwen2.5-VL-3B2026.03 | 41.66 | 45.82 | |
| RandomModel=Qwen2.5-VL-7B2026.03 | 41.66 | 46.2 | |
| RandomModel=Qwen2.5-VL-3B2026.03 | 41.54 | 45.3 | |
| MMICESModel=Qwen2.5-VL-3B2026.03 | 39.32 | 42.95 | |
| CIRCLESModel=Gemma3-12B2026.03 | 37.75 | 43.23 | |
| RICESModel=Gemma3-12B2026.03 | 36.86 | 42.61 | |
| MUIERModel=Gemma3-12B2026.03 | 36.58 | 42.3 | |
| MMICESModel=Gemma3-12B2026.03 | 35.12 | 40.85 | |
| RandomModel=Gemma3-12B2026.03 | 33.59 | 39.56 | |
| NoneModel=Qwen2.5-VL-7B2026.03 | 33.31 | 38.33 | |
| CIRCLESModel=Gemma3-4B2026.03 | 31.27 | 36.89 | |
| MUIERModel=Gemma3-4B2026.03 | 26.87 | 32.82 | |
| RICESModel=Gemma3-4B2026.03 | 26.65 | 32.72 | |
| MMICESModel=Gemma3-4B2026.03 | 26.24 | 32.41 | |
| NoneModel=Gemma3-12B2026.03 | 25.47 | 33.89 | |
| RandomModel=Gemma3-4B2026.03 | 24.81 | 30.74 | |
| NoneModel=Gemma3-4B2026.03 | 19.12 | 26.7 |