Visual Question Answering on VizWizQA
78.9AccuracyPragma-VL
Evaluation Results
| Method | Links | |
|---|---|---|
| Pragma-VLBackbone=Qwen2.5-VL-7B2026.02 | 78.9 | |
| DPOBackbone=Qwen2.5-VL-7B2026.02 | 73.81 | |
| Qwen2.5-VL-7BBackbone=Qwen2.5-VL-7B2026.02 | 72.53 | |
| SPA-VLBackbone=Qwen2.5-VL-7B2026.02 | 71.65 | |
| DPOBackbone=Llava-1.5-7B2026.02 | 69.2 | |
| SFTBackbone=Llava-1.5-7B2026.02 | 69.03 | |
| Llava-1.5-7BBackbone=Llava-1.5-7B2026.02 | 68.93 | |
| Beavertails-V_helpBackbone=Qwen2.5-VL-7B2026.02 | 68.85 | |
| SFTBackbone=Qwen2.5-VL-7B2026.02 | 68.64 | |
| MM-RLHFBackbone=Qwen2.5-VL-7B2026.02 | 68.07 | |
| Pragma-VLBackbone=Llava-1.5-7B2026.02 | 67.78 | |
| Beavertails-V_harmBackbone=Llava-1.5-7B2026.02 | 66.69 | |
| Yi-VL-6BFinetuning Dataset=Origin2025.04 | 66.2 | |
| MM-RLHFBackbone=Llava-1.5-7B2026.02 | 66.14 | |
| LLaVA-NeXT-Mistral-7BFinetuning Dataset=Origin2025.04 | 64.98 | |
| Beavertails-V_harmBackbone=Qwen2.5-VL-7B2026.02 | 64.26 | |
| mPLUG-Owl3# Param=8B2024.08 | 63.5 | |
| SPA-VLBackbone=Llava-1.5-7B2026.02 | 62.59 | |
| Beavertails-V_helpBackbone=Llava-1.5-7B2026.02 | 60.07 | |
| Yi-VL-6BFinetuning Dataset=VLGuard2025.04 | 59.32 | |
| LLaVA-v1.5-13BFinetuning Dataset=Ours2025.04 | 58.77 | |
| VILA-1.5# Param=8B2024.08 | 58.7 | |
| LLAVA-Next# Param=8B2024.08 | 57.6 | |
| LLaVA-v1.5-13BFinetuning Dataset=Origin2025.04 | 57.34 | |
| Flamingo# Param=80B2024.08 | 57.2 | |
| LLaVA-v1.5-13BFinetuning Dataset=VLGuard2025.04 | 56.77 | |
| LLaVA-v1.5-7BFinetuning Dataset=VLGuard2025.04 | 56.36 | |
| LLaVA-v1.5-7BFinetuning Dataset=Ours2025.04 | 55.92 | |
| LLaVA-NeXT-Mistral-7BFinetuning Dataset=Ours2025.04 | 55.5 | |
| LLaVA-v1.5-7BFinetuning Dataset=Origin2025.04 | 55.1 | |
| mPLUG-Owl2# Param=8B2024.08 | 54.5 | |
| LLaVA-NeXT-Mistral-7BFinetuning Dataset=VLGuard2025.04 | 53.15 | |
| LLAVA-1.5# Param=8B2024.08 | 50 | |
| Yi-VL-6BFinetuning Dataset=Ours2025.04 | 47.91 | |
| EVLM-Chat# Param=32B2024.08 | 47.3 | |
| Qwen-VL-Chat# Param=9B2024.08 | 38.9 | |
| InstructBLIP# Param=7B2024.08 | 34.5 |