Helpfulness Evaluation on MM-Vet2 (test)
54.4GPT-Eval ScoreNo Defense
Evaluation Results
| Method | Links | |
|---|---|---|
| No DefenseBackbone=Qwen2-VL2025.08 | 54.4 | |
| PRISMBackbone=Qwen2-VL2025.08 | 48.9 | |
| SPA-VLBackbone=Qwen2-VL2025.08 | 46.8 | |
| PRISMBackbone=LLaVA-1.52025.08 | 20.4 | |
| SPA-VLBackbone=LLaVA-1.52025.08 | 20.2 | |
| SafeRLHF-VBackbone=LLaVA-1.52025.08 | 19.3 | |
| VLGuardBackbone=Qwen2-VL2025.08 | 17.7 | |
| No DefenseBackbone=LLaVA-1.52025.08 | 13.1 | |
| SafeRLHF-VBackbone=Qwen2-VL2025.08 | 12.9 | |
| VLGuardBackbone=LLaVA-1.52025.08 | 12.3 |