Safety Evaluation on Holisafe Text+Image
91.13RSROmniSteer
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OmniSteerModel=Baichuan-Omni-1d52026.02 | 91.13 | 96.48 | 92.04 | |
| OmniSteerModel=MiniCPM-o-2.62026.02 | 90.75 | 95.45 | 91.54 | |
| Self-ReminderModel=MiniCPM-o-2.62026.02 | 89.28 | 98.68 | 90.87 | |
| Self-ReminderModel=Baichuan-Omni-1d52026.02 | 88.87 | 89.72 | 89.01 | |
| OmniSteerModel=Qwen2.5-Omni-7B2026.02 | 85.31 | 98.53 | 87.55 | |
| OmniGuardModel=Baichuan-Omni-1d52026.02 | 77.97 | 96.18 | 81.05 | |
| VanillaModel=Baichuan-Omni-1d52026.02 | 77.4 | 97.06 | 80.72 | |
| OmniGuardModel=Qwen2.5-Omni-7B2026.02 | 68.96 | 98.24 | 73.9 | |
| Self-ReminderModel=Qwen2.5-Omni-7B2026.02 | 59.97 | 98.83 | 66.53 | |
| VanillaModel=MiniCPM-o-2.62026.02 | 54.81 | 98.97 | 62.27 | |
| OmniGuardModel=MiniCPM-o-2.62026.02 | 54 | 98.68 | 61.55 | |
| VanillaModel=Qwen2.5-Omni-7B2026.02 | 48.24 | 98.53 | 56.74 |