Visual Question Answering on SEA-VQA
56.25Accuracy (Cambodia)Aya-Vision
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Aya-VisionNumber of Parameters=32B2026.04 | 56.25 | 66.09 | 45.83 | 69.31 | 63.4 | 71.88 | 49.46 | 63.26 | 60.68 | |
| SEA-Gemma-3Number of Parameters=27B, Training Budget=10%2026.04 | 52.3 | 69 | 68.1 | 62.4 | 58.8 | 68.8 | 52.2 | 57.5 | 61.1 | |
| Qwen-3 VLNumber of Parameters=35B2026.04 | 50.99 | 66.09 | 63.89 | 60.32 | 56.21 | 65.63 | 52.72 | 53.04 | 58.61 | |
| Gemma-3Number of Parameters=27B2026.04 | 50.7 | 43.5 | 0 | 37.5 | 63.4 | 56.3 | 51.6 | 18.9 | 40.2 | |
| SEA-Gemma-3Number of Parameters=27B2026.04 | 40.5 | 49.3 | 50 | 44.4 | 46.6 | 46.9 | 39.1 | 18.5 | 41.9 |