Safety Evaluation on BeaverTails Audio 1K
98.95RSROmniGuard
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OmniGuardModel=Baichuan-Omni-1d52026.02 | 98.95 | 34.97 | 71.44 | |
| OmniSteerModel=Qwen2.5-Omni-7B2026.02 | 96.66 | 75.99 | 87.78 | |
| VanillaModel=Baichuan-Omni-1d52026.02 | 94.73 | 78.79 | 87.88 | |
| Self-ReminderModel=Baichuan-Omni-1d52026.02 | 94.55 | 77.39 | 87.17 | |
| OmniSteerModel=Baichuan-Omni-1d52026.02 | 93.15 | 77.86 | 86.57 | |
| VanillaModel=MiniCPM-o-2.62026.02 | 89.1 | 73.89 | 82.57 | |
| Self-ReminderModel=MiniCPM-o-2.62026.02 | 87.7 | 74.36 | 81.96 | |
| OmniSteerModel=MiniCPM-o-2.62026.02 | 87.52 | 75.06 | 82.16 | |
| OmniGuardModel=MiniCPM-o-2.62026.02 | 86.99 | 71.56 | 80.36 | |
| OmniGuardModel=Qwen2.5-Omni-7B2026.02 | 83.66 | 76.92 | 80.76 | |
| Self-ReminderModel=Qwen2.5-Omni-7B2026.02 | 82.6 | 83.92 | 83.17 | |
| VanillaModel=Qwen2.5-Omni-7B2026.02 | 81.72 | 86.01 | 83.57 |