Safety Evaluation on OmniSafety (T+I+A)
99.93RSROmniSteer
Evaluation results
| Method | Links | |
|---|---|---|
| OmniSteerModel=Qwen2.5-Omni-7B2026.02 | 99.93 | |
| OmniSteerModel=Baichuan-Omni-1d52026.02 | 99.01 | |
| Self-ReminderModel=Baichuan-Omni-1d52026.02 | 90.25 | |
| OmniGuardModel=Qwen2.5-Omni-7B2026.02 | 75.27 | |
| Self-ReminderModel=Qwen2.5-Omni-7B2026.02 | 74.91 | |
| OmniGuardModel=Baichuan-Omni-1d52026.02 | 65.98 | |
| VanillaModel=Baichuan-Omni-1d52026.02 | 64.35 | |
| Self-ReminderModel=MiniCPM-o-2.62026.02 | 63.33 | |
| VanillaModel=Qwen2.5-Omni-7B2026.02 | 52.49 | |
| OmniSteerModel=MiniCPM-o-2.62026.02 | 40.91 | |
| VanillaModel=MiniCPM-o-2.62026.02 | 25.47 | |
| OmniGuardModel=MiniCPM-o-2.62026.02 | 25.38 |