Visual Question Answering on HoraVQA (curated)
61HoraVQA ScoreQwen2.5-VL-7B-Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-VL-7B-InstructParameters=7B2026.05 | 61 | |
| Qwen3-VL-8B-InstructParameters=8B2026.05 | 60.81 | |
| Qwen3-VL-4B-InstructParameters=4B2026.05 | 58.98 | |
| Gemma3-12B-itParameters=12B2026.05 | 58.91 | |
| Qwen2-VL-7B-InstructParameters=7B2026.05 | 58.09 | |
| RO-Qwen2.5-VL-3BParameters=3B2026.05 | 56.36 | |
| RO-Qwen2-VL-2BParameters=2B2026.05 | 56.09 | |
| Qwen2.5-VL-3B-InstructParameters=3B2026.05 | 54.19 | |
| RO-Qwen3-VL-2BParameters=2B2026.05 | 54 | |
| RO-Gemma3-4BParameters=4B2026.05 | 52.84 | |
| Gemma3-4B-itParameters=4B2026.05 | 52.19 | |
| Qwen3-VL-2B-InstructParameters=2B2026.05 | 50.31 | |
| RO-LLaVA-NeXT-Llama3-8BLanguage Backbone=RoLlama3-8b-Instruct, Parameters=8B2026.05 | 47.78 | |
| Qwen2-VL-2B-InstructParameters=2B2026.05 | 46.24 | |
| LLaVA-NeXT-Llama3-8BLanguage Backbone=Llama3-8B-Instruct, Parameters=8B2026.05 | 40.6 |