Safety Evaluation on Omni-SafetyBench (test)
17.1ASR (Image Avg)ReGap
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ReGapBackbone=Qwen2.5-Omni-3B2026.05 | 17.1 | 8.9 | 25.8 | 25.8 | 34 | 20.8 | |
| ReGapBackbone=MiniCPM-o-4.52026.05 | 30.6 | 14.2 | 16.6 | 9.1 | 63 | 27.8 | |
| VLGuard-SFTBackbone=Qwen2.5-Omni-3B2026.05 | 34.1 | 37.4 | 21 | 19.2 | 72.8 | 36.1 | |
| ReGapBackbone=Qwen3-Omni-30B-A3B-Instruct2026.05 | 48.5 | 8.8 | 14.1 | 11.8 | 12 | 27.5 | |
| ShiftDCBackbone=Qwen2.5-Omni-3B2026.05 | 53 | 1 | 27.2 | 0.2 | 44.4 | 33.1 | |
| ShiftDCBackbone=Qwen3-Omni-30B-A3B-Instruct2026.05 | 54.1 | 10.4 | 17.2 | 0.8 | 14 | 29.2 | |
| SPA-VL-DPOBackbone=Qwen2.5-Omni-3B2026.05 | 63.2 | 45.8 | 35.2 | 34.2 | 88.6 | 56.2 | |
| ShiftDCBackbone=MiniCPM-o-4.52026.05 | 70.7 | 2.2 | 35 | 3.8 | 76.4 | 47.1 | |
| BaseBackbone=Qwen2.5-Omni-3B2026.05 | 82.1 | 56.6 | 48.8 | 43 | 65.6 | 65.7 | |
| BaseBackbone=Qwen3-Omni-30B-A3B-Instruct2026.05 | 83.8 | 20.8 | 22.4 | 12.6 | 74.4 | 54.5 | |
| BaseBackbone=MiniCPM-o-4.52026.05 | 86.4 | 57.6 | 35.2 | 24 | 72.6 | 64.1 |